Max level shown:
1 [ Jan 13 22:40:23 Enabled. ]
2 [ Jan 13 22:40:23 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 13 22:40:23 Method "start" exited with status 0. ]
4 [ Jan 13 22:40:23 Rereading configuration. ]
5 [ Jan 13 22:40:23 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-13T22:40:23.574ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-13T22:40:23.574ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-13T22:40:23.626ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-13T22:40:23.626ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-13T22:40:23.741ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-13T22:40:23.749ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-13T22:40:23.757ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-13T22:40:24.360ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-13T22:40:24.497ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-13T22:40:24.497ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-13T22:40:24.497ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-13T22:40:24.497ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-13T22:40:24.497ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-13T22:40:24.497ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-13T22:40:24.500ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-13T22:40:24.500ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-13T22:40:24.500ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-13T22:40:24.500ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-13T22:40:24.500ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-13T22:40:24.500ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-13T22:40:24.501ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-13T22:40:24.501ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-13T22:40:24.501ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-13T22:40:24.512ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-13T22:40:24.512ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool)
322025-01-13T22:40:24.609ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal }
332025-01-13T22:40:24.974ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-13T22:40:24.974ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-13T22:40:24.974ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-13T22:40:24.974ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-13T22:40:24.974ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-13T22:40:24.974ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-13T22:40:24.974ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-13T22:40:24.982ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-13T22:40:24.982ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool)
422025-01-13T22:40:25.069ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal }
432025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-13T22:40:25.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-01-13T22:40:25.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-01-13T22:40:25.435ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-13T22:40:25.435ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-13T22:40:25.435ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-13T22:40:25.435ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-13T22:40:25.435ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-13T22:40:25.435ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-13T22:40:25.435ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-13T22:40:25.435ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-13T22:40:25.435ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-13T22:40:25.447ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-13T22:40:25.447ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3085, tv_nsec: 299181876 } time_to_next_cleanup = 599.999931808s
1142025-01-13T22:40:25.447ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-13T22:40:25.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-13T22:40:25.447ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-13T22:40:25.447ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-13T22:40:25.450ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-13T22:40:25.451ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-13T22:40:25.452ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-13T22:40:25.452ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-13T22:40:25.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-13T22:40:25.452ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-13T22:40:25.452ZINFOSledAgent (RSS): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-13T22:40:25.452ZINFOSledAgent (RSS): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-13T22:40:25.452ZINFOSledAgent (RSS): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-13T22:40:25.452ZINFOSledAgent (RSS): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-13T22:40:25.452ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-13T22:40:25.452ZINFOSledAgent (RSS): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-13T22:40:25.452ZINFOSledAgent (RSS): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-13T22:40:25.452ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-13T22:40:25.452ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-13T22:40:25.452ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-13T22:40:25.453ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-13T22:40:25.453ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-13T22:40:25.453ZINFOSledAgent (bootstore): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-13T22:40:25.453ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-13T22:40:25.453ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-13T22:40:25.453ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bd8d50a3-f530-430e-8ded-11b6657cae3b (sled), rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-13T22:40:25.454ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-13T22:40:25.454ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-13T22:40:25.458ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-13T22:40:25.464ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-13T22:40:25.464ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-13T22:40:25.469ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-13T22:40:25.469ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-13T22:40:25.469ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65339
1482025-01-13T22:40:25.469ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: bd8d50a3-f530-430e-8ded-11b6657cae3b (sled), rack_id: 646472ad-69b3-4142-8cd4-bbfc619624e6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-13T22:40:25.469ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-13T22:40:25.469ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522025-01-13T22:40:25.469ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1532025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-13T22:40:25.469ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-13T22:40:25.469ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-13T22:40:25.470ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-13T22:40:25.470ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-13T22:40:25.487ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-13T22:40:25.507ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-13T22:40:25.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-13T22:40:25.533ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1662025-01-13T22:40:25.533ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-13T22:40:25.533ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1682025-01-13T22:40:25.533ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-13T22:40:25.536ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 67.808218ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "992a26af-23c7-4b12-992e-f56aebf8b546", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "992a26af-23c7-4b12-992e-f56aebf8b546" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-13T22:40:25.546ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_56697609-d0f2-4d98-a708-6ef6ae2c5907/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-13T22:40:25.568ZINFOSledAgent: successfully created encrypted zvol: name="oxi_56697609-d0f2-4d98-a708-6ef6ae2c5907/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-13T22:40:25.568ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_56697609-d0f2-4d98-a708-6ef6ae2c5907/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-13T22:40:25.573ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1742025-01-13T22:40:25.573ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-13T22:40:25.573ZINFOSledAgent (BackingFs): Ensuring dataset oxi_56697609-d0f2-4d98-a708-6ef6ae2c5907/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-13T22:40:25.605ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-13T22:40:25.606ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 80.665916ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "805492ea-403a-4195-b907-2908033c05a1", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "805492ea-403a-4195-b907-2908033c05a1" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-13T22:40:25.640ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-13T22:40:25.688ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-13T22:40:25.688ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 72.703788ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9b103df6-26b4-4cb7-bf6a-ad8aec4c1af4", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9b103df6-26b4-4cb7-bf6a-ad8aec4c1af4" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-13T22:40:25.762ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822025-01-13T22:40:25.763ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 186.873069ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7fbd6970-1045-454a-bada-bedbd4f6c49e", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7fbd6970-1045-454a-bada-bedbd4f6c49e" } file = clients/ddm-admin-client/src/lib.rs:177
1832025-01-13T22:40:25.859ZINFOSledAgent (BackingFs): Mounting oxi_56697609-d0f2-4d98-a708-6ef6ae2c5907/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1842025-01-13T22:40:25.871ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1852025-01-13T22:40:25.871ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1862025-01-13T22:40:25.871ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1872025-01-13T22:40:25.871ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1882025-01-13T22:40:25.951ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-13T22:40:25.951ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 182.014508ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a885e36-a307-4c43-907e-153a5075faf6", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a885e36-a307-4c43-907e-153a5075faf6" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-13T22:40:26.135ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-13T22:40:26.136ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 341.204604ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "feafdadb-9638-47bc-ba1d-636f07db0e4d", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:25 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "feafdadb-9638-47bc-ba1d-636f07db0e4d" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-13T22:40:26.478ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-13T22:40:26.478ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 298.551115ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aa7acc7e-bb27-49f7-946c-0c2dc27cc7c3", "content-length": "124", "date": "Mon, 13 Jan 2025 22:40:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aa7acc7e-bb27-49f7-946c-0c2dc27cc7c3" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-13T22:40:26.601ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1952025-01-13T22:40:26.606ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:42873 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1962025-01-13T22:40:26.606ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1972025-01-13T22:40:26.607ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:42873 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = bd8d50a3-f530-430e-8ded-11b6657cae3b sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1982025-01-13T22:40:26.608ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 190.437158ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
1992025-01-13T22:40:26.609ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2002025-01-13T22:40:26.609ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2012025-01-13T22:40:26.609ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2022025-01-13T22:40:26.609ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-13T22:40:26.778ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-13T22:40:26.799ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 529.930451ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2052025-01-13T22:40:27.333ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 816.48218ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2062025-01-13T22:40:28.151ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.923086253s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2072025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2082025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2092025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2102025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2112025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2122025-01-13T22:40:29.169ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2132025-01-13T22:40:29.171ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2142025-01-13T22:40:29.172ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2152025-01-13T22:40:29.172ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='f1be7baf-c827-426e-9981-cc29320d7f50'/> <propval type="astring" name="rack_id" value='646472ad-69b3-4142-8cd4-bbfc619624e6'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fea2:e5e7'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='646472ad-69b3-4142-8cd4-bbfc619624e6'/> <propval type="astring" name="sled_id" value='bd8d50a3-f530-430e-8ded-11b6657cae3b'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='bd8d50a3-f530-430e-8ded-11b6657cae3b'/> <propval type="astring" name="rack_uuid" value='646472ad-69b3-4142-8cd4-bbfc619624e6'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='bd8d50a3-f530-430e-8ded-11b6657cae3b'/> <propval type="astring" name="rack_uuid" value='646472ad-69b3-4142-8cd4-bbfc619624e6'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-13T22:40:29.172ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-13T22:40:29.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 42.468015ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-13T22:40:29.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 128.108587ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-13T22:40:29.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 137.581083ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-13T22:40:30.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 516.22837ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-13T22:40:30.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 790.510408ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-13T22:40:31.076ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.5413139s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2232025-01-13T22:40:31.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.448978516s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-13T22:40:33.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 919.304766ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-13T22:40:33.619ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.374850151s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2262025-01-13T22:40:34.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 877.323959ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272025-01-13T22:40:35.715ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/nexus.rs:527 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2282025-01-13T22:40:35.745ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-13T22:40:35.745ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2302025-01-13T22:40:35.747ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-13T22:40:35.747ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-13T22:40:35.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332025-01-13T22:40:35.747ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-13T22:40:35.747ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-13T22:40:35.747ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-13T22:40:35.747ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-13T22:40:35.747ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2382025-01-13T22:40:35.747ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65339
2392025-01-13T22:40:35.972ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-01-13T22:40:35.972ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-13T22:40:35.977ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-13T22:40:36.632ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2432025-01-13T22:40:36.632ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2442025-01-13T22:40:36.861ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2452025-01-13T22:40:36.863ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2462025-01-13T22:40:36.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34605
2472025-01-13T22:40:36.864ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-01-13T22:40:36.865ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-01-13T22:40:36.865ZINFOSledAgent (ServiceManager): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-01-13T22:40:36.865ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-01-13T22:40:36.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34605 req_id = 3e4c3812-abb0-4009-8584-4c9375af2019 response_code = 200 uri = /inventory
2522025-01-13T22:40:36.879ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2532025-01-13T22:40:36.879ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2542025-01-13T22:40:36.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37103
2552025-01-13T22:40:36.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37103 req_id = c47bf4d5-3b65-46b4-9f26-8c84fa918eff response_code = 200 uri = /sled-role
2562025-01-13T22:40:36.957ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 122725d5-e052-49e4-bfac-2be707a4de5e (physical_disk), pool_id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 05a31a79-2912-457b-9074-3a41e4fc7605 (physical_disk), pool_id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 850fbed0-febc-4c49-a762-4d5c74b6ec13 (physical_disk), pool_id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4d7549b2-59e4-4d6f-8dea-5e349fa005b6 (physical_disk), pool_id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: e3faff02-8ef3-4d44-908e-1c986611caef (physical_disk), pool_id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 422f9203-6326-43f8-affb-a1e8890290c7 (physical_disk), pool_id: 9260d14e-3165-43af-a297-8b2685485aec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bdd1bfdb-7e38-4ec2-a2de-ffcecfb5deb8 (physical_disk), pool_id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 88688a9c-28db-474f-b6ba-d20b175e2f51 (physical_disk), pool_id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 19547256-0d1c-4eb6-8c4d-b14acf3f6557 (physical_disk), pool_id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2572025-01-13T22:40:36.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41649
2582025-01-13T22:40:36.957ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
2592025-01-13T22:40:36.957ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 122725d5-e052-49e4-bfac-2be707a4de5e (physical_disk), pool_id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 05a31a79-2912-457b-9074-3a41e4fc7605 (physical_disk), pool_id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 850fbed0-febc-4c49-a762-4d5c74b6ec13 (physical_disk), pool_id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4d7549b2-59e4-4d6f-8dea-5e349fa005b6 (physical_disk), pool_id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: e3faff02-8ef3-4d44-908e-1c986611caef (physical_disk), pool_id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 422f9203-6326-43f8-affb-a1e8890290c7 (physical_disk), pool_id: 9260d14e-3165-43af-a297-8b2685485aec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: bdd1bfdb-7e38-4ec2-a2de-ffcecfb5deb8 (physical_disk), pool_id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 88688a9c-28db-474f-b6ba-d20b175e2f51 (physical_disk), pool_id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 19547256-0d1c-4eb6-8c4d-b14acf3f6557 (physical_disk), pool_id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2602025-01-13T22:40:36.957ZINFOSledAgent (StorageManager): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612025-01-13T22:40:36.957ZINFOSledAgent (StorageManager): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2622025-01-13T22:40:36.957ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2632025-01-13T22:40:36.957ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2642025-01-13T22:40:36.957ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2652025-01-13T22:40:36.957ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2662025-01-13T22:40:36.957ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2672025-01-13T22:40:36.968ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2682025-01-13T22:40:36.968ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool)
2692025-01-13T22:40:37.017ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2702025-01-13T22:40:37.017ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2712025-01-13T22:40:37.065ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }
2722025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2732025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2742025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2752025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2762025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782025-01-13T22:40:37.072ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2792025-01-13T22:40:37.103ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2802025-01-13T22:40:37.110ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone file = sled-storage/src/dataset.rs:302
2812025-01-13T22:40:37.235ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e file = sled-storage/src/dataset.rs:388
2822025-01-13T22:40:37.242ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2832025-01-13T22:40:37.242ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2842025-01-13T22:40:37.242ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2852025-01-13T22:40:37.242ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2862025-01-13T22:40:37.242ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2872025-01-13T22:40:37.252ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2882025-01-13T22:40:37.252ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool)
2892025-01-13T22:40:37.343ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }
2902025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2912025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2922025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2932025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2942025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962025-01-13T22:40:37.351ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2972025-01-13T22:40:37.386ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982025-01-13T22:40:37.393ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone file = sled-storage/src/dataset.rs:302
2992025-01-13T22:40:37.529ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612 file = sled-storage/src/dataset.rs:388
3002025-01-13T22:40:37.536ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3012025-01-13T22:40:37.536ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3022025-01-13T22:40:37.536ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3032025-01-13T22:40:37.536ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3042025-01-13T22:40:37.536ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052025-01-13T22:40:37.546ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3062025-01-13T22:40:37.546ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool)
3072025-01-13T22:40:37.636ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }
3082025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3092025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3102025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3112025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3122025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142025-01-13T22:40:37.644ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3152025-01-13T22:40:37.680ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162025-01-13T22:40:37.688ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone file = sled-storage/src/dataset.rs:302
3172025-01-13T22:40:37.822ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a file = sled-storage/src/dataset.rs:388
3182025-01-13T22:40:37.830ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192025-01-13T22:40:37.830ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202025-01-13T22:40:37.830ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212025-01-13T22:40:37.830ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222025-01-13T22:40:37.830ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232025-01-13T22:40:37.839ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242025-01-13T22:40:37.839ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool)
3252025-01-13T22:40:37.929ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }
3262025-01-13T22:40:37.937ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272025-01-13T22:40:37.937ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282025-01-13T22:40:37.937ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292025-01-13T22:40:37.937ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302025-01-13T22:40:37.937ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-13T22:40:37.938ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-13T22:40:37.938ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332025-01-13T22:40:37.941ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
3342025-01-13T22:40:37.972ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3352025-01-13T22:40:37.980ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone file = sled-storage/src/dataset.rs:302
3362025-01-13T22:40:37.999ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 23.618445955s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
3372025-01-13T22:40:38.119ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_68c5966c-8942-45eb-a621-8fc500b81f8f file = sled-storage/src/dataset.rs:388
3382025-01-13T22:40:38.127ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3392025-01-13T22:40:38.127ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3402025-01-13T22:40:38.127ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3412025-01-13T22:40:38.127ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3422025-01-13T22:40:38.127ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3432025-01-13T22:40:38.137ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3442025-01-13T22:40:38.137ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool)
3452025-01-13T22:40:38.230ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }
3462025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3472025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3482025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3492025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3502025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3522025-01-13T22:40:38.238ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3532025-01-13T22:40:38.271ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3542025-01-13T22:40:38.279ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone file = sled-storage/src/dataset.rs:302
3552025-01-13T22:40:38.417ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250 file = sled-storage/src/dataset.rs:388
3562025-01-13T22:40:38.425ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3572025-01-13T22:40:38.425ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3582025-01-13T22:40:38.425ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3592025-01-13T22:40:38.425ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3602025-01-13T22:40:38.425ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3612025-01-13T22:40:38.435ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3622025-01-13T22:40:38.435ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9260d14e-3165-43af-a297-8b2685485aec (zpool)
3632025-01-13T22:40:38.529ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }
3642025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3652025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3662025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3672025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3682025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3702025-01-13T22:40:38.537ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3712025-01-13T22:40:38.573ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3722025-01-13T22:40:38.581ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9260d14e-3165-43af-a297-8b2685485aec/crypt/zone file = sled-storage/src/dataset.rs:302
3732025-01-13T22:40:38.720ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9260d14e-3165-43af-a297-8b2685485aec file = sled-storage/src/dataset.rs:388
3742025-01-13T22:40:38.728ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3752025-01-13T22:40:38.728ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3762025-01-13T22:40:38.728ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3772025-01-13T22:40:38.728ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3782025-01-13T22:40:38.728ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3792025-01-13T22:40:38.738ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3802025-01-13T22:40:38.738ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool)
3812025-01-13T22:40:38.829ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }
3822025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3832025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3842025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3852025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3862025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882025-01-13T22:40:38.837ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3892025-01-13T22:40:38.872ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3902025-01-13T22:40:38.880ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone file = sled-storage/src/dataset.rs:302
3912025-01-13T22:40:38.944ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
3922025-01-13T22:40:39.017ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477 file = sled-storage/src/dataset.rs:388
3932025-01-13T22:40:39.025ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3942025-01-13T22:40:39.025ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3952025-01-13T22:40:39.025ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3962025-01-13T22:40:39.025ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3972025-01-13T22:40:39.025ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3982025-01-13T22:40:39.035ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3992025-01-13T22:40:39.035ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool)
4002025-01-13T22:40:39.132ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }
4012025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4022025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4032025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4042025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4052025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072025-01-13T22:40:39.141ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4082025-01-13T22:40:39.177ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4092025-01-13T22:40:39.185ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone file = sled-storage/src/dataset.rs:302
4102025-01-13T22:40:39.321ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447 file = sled-storage/src/dataset.rs:388
4112025-01-13T22:40:39.329ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4122025-01-13T22:40:39.329ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4132025-01-13T22:40:39.329ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4142025-01-13T22:40:39.329ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4152025-01-13T22:40:39.329ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4162025-01-13T22:40:39.339ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4172025-01-13T22:40:39.339ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool)
4182025-01-13T22:40:39.429ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }
4192025-01-13T22:40:39.437ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4202025-01-13T22:40:39.437ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4212025-01-13T22:40:39.438ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4222025-01-13T22:40:39.438ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4232025-01-13T22:40:39.438ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-13T22:40:39.438ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252025-01-13T22:40:39.438ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4262025-01-13T22:40:39.474ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4272025-01-13T22:40:39.481ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone file = sled-storage/src/dataset.rs:302
4282025-01-13T22:40:39.639ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab file = sled-storage/src/dataset.rs:388
4292025-01-13T22:40:39.647ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4302025-01-13T22:40:39.647ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4312025-01-13T22:40:39.647ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-13T22:40:39.647ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56697609-d0f2-4d98-a708-6ef6ae2c5907 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c567ebae-c1ad-4ae4-b2e9-85be19dddc71 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4332025-01-13T22:40:39.647ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4342025-01-13T22:40:39.647ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4352025-01-13T22:40:39.647ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362025-01-13T22:40:39.647ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4372025-01-13T22:40:39.647ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4382025-01-13T22:40:39.647ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4392025-01-13T22:40:39.647ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4402025-01-13T22:40:39.647ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4412025-01-13T22:40:39.647ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4422025-01-13T22:40:39.647ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4432025-01-13T22:40:39.648ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4442025-01-13T22:40:39.648ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4452025-01-13T22:40:39.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690722 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41649 req_id = 913e5ed1-f810-44fe-8e26-04f73022a1ff response_code = 200 uri = /omicron-physical-disks
4462025-01-13T22:40:39.679ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01498782-306b-4b92-8f64-5eb4db7e013c (dataset): DatasetConfig { id: 01498782-306b-4b92-8f64-5eb4db7e013c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 02ab6fbb-c726-4799-a32c-60f38f1c06c1 (dataset): DatasetConfig { id: 02ab6fbb-c726-4799-a32c-60f38f1c06c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 039224a8-f0b9-4ae1-a9c5-d52348c16fb1 (dataset): DatasetConfig { id: 039224a8-f0b9-4ae1-a9c5-d52348c16fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 058be9db-981a-40c9-a985-921524886dac (dataset): DatasetConfig { id: 058be9db-981a-40c9-a985-921524886dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 059df9d3-2b41-443c-be67-e410afb9ee46 (dataset): DatasetConfig { id: 059df9d3-2b41-443c-be67-e410afb9ee46 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1121b13a-fdcf-46f2-bdb1-987403c011e0 (dataset): DatasetConfig { id: 1121b13a-fdcf-46f2-bdb1-987403c011e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 119719b6-85d1-4408-b8cd-5d4541c9db31 (dataset): DatasetConfig { id: 119719b6-85d1-4408-b8cd-5d4541c9db31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19594402-3352-47d4-9949-6b95814d77db (dataset): DatasetConfig { id: 19594402-3352-47d4-9949-6b95814d77db (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e56e2f0-afb4-466d-a4f6-866868e27f17 (dataset): DatasetConfig { id: 1e56e2f0-afb4-466d-a4f6-866868e27f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f306c66-6a41-4ebd-9388-18fe40af2bea (dataset): DatasetConfig { id: 1f306c66-6a41-4ebd-9388-18fe40af2bea (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 241a1ea3-513e-493e-b81f-cccecd394c3d (dataset): DatasetConfig { id: 241a1ea3-513e-493e-b81f-cccecd394c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24db753e-8595-4e81-87e7-11cf77e075cd (dataset): DatasetConfig { id: 24db753e-8595-4e81-87e7-11cf77e075cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2592c8b2-9ff3-4f32-be3f-444389f96dec (dataset): DatasetConfig { id: 2592c8b2-9ff3-4f32-be3f-444389f96dec (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27fb7d2c-f5b4-4703-8c31-0a5a621d1c1d (dataset): DatasetConfig { id: 27fb7d2c-f5b4-4703-8c31-0a5a621d1c1d (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a6af61d-1447-428f-af2f-152399e8d391 (dataset): DatasetConfig { id: 2a6af61d-1447-428f-af2f-152399e8d391 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 30224445-7cde-4601-b291-a0f653ee0c8e (dataset): DatasetConfig { id: 30224445-7cde-4601-b291-a0f653ee0c8e (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36647c6d-0c7c-4dba-a2db-ca6420155332 (dataset): DatasetConfig { id: 36647c6d-0c7c-4dba-a2db-ca6420155332 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 374c3468-5e40-4b4c-a3c8-4ce354483760 (dataset): DatasetConfig { id: 374c3468-5e40-4b4c-a3c8-4ce354483760 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3946e8d9-5f80-4699-bbfa-61dd5071cb4a (dataset): DatasetConfig { id: 3946e8d9-5f80-4699-bbfa-61dd5071cb4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b0ea56a-a889-4b60-bf95-e7e524e05e51 (dataset): DatasetConfig { id: 3b0ea56a-a889-4b60-bf95-e7e524e05e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3c46b1b2-9b87-4ca1-80cc-4a3efc2942b3 (dataset): DatasetConfig { id: 3c46b1b2-9b87-4ca1-80cc-4a3efc2942b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e7448f2-453f-4e91-9925-7bfbfcf6025d (dataset): DatasetConfig { id: 3e7448f2-453f-4e91-9925-7bfbfcf6025d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af02f24-6295-42f5-9958-ab9baf5e6004 (dataset): DatasetConfig { id: 4af02f24-6295-42f5-9958-ab9baf5e6004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55d7cb87-8b6d-4980-844e-1307d65224b4 (dataset): DatasetConfig { id: 55d7cb87-8b6d-4980-844e-1307d65224b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 565189d7-b48b-4c47-993f-5c78b5fcff6d (dataset): DatasetConfig { id: 565189d7-b48b-4c47-993f-5c78b5fcff6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb76e8b-66d8-45e3-bb88-e0d6304fa4c6 (dataset): DatasetConfig { id: 5cb76e8b-66d8-45e3-bb88-e0d6304fa4c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e2bab1f-2347-4430-bac3-b9fb72129dc9 (dataset): DatasetConfig { id: 5e2bab1f-2347-4430-bac3-b9fb72129dc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61a995b6-a0d8-4d1c-b14e-df95392da06f (dataset): DatasetConfig { id: 61a995b6-a0d8-4d1c-b14e-df95392da06f (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69d421ea-992e-47e1-9cd7-876bcb9a6b1c (dataset): DatasetConfig { id: 69d421ea-992e-47e1-9cd7-876bcb9a6b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf4dc29-133f-482c-8178-edcc88f16b0f (dataset): DatasetConfig { id: 6cf4dc29-133f-482c-8178-edcc88f16b0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d7d3b72-336a-4e8e-941d-8a72d0c7eb1b (dataset): DatasetConfig { id: 6d7d3b72-336a-4e8e-941d-8a72d0c7eb1b (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 74b3941b-fb8e-42a8-96a7-d2592a4c294f (dataset): DatasetConfig { id: 74b3941b-fb8e-42a8-96a7-d2592a4c294f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a30d896-96a2-440c-ba76-67713fd15873 (dataset): DatasetConfig { id: 7a30d896-96a2-440c-ba76-67713fd15873 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e43eab7-78b6-424e-a84e-cdfd8e2a57f0 (dataset): DatasetConfig { id: 7e43eab7-78b6-424e-a84e-cdfd8e2a57f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863d99c6-9c5d-411f-9ae4-aed014b4888a (dataset): DatasetConfig { id: 863d99c6-9c5d-411f-9ae4-aed014b4888a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d13dfed-a840-427f-9248-c80fe9c8d963 (dataset): DatasetConfig { id: 8d13dfed-a840-427f-9248-c80fe9c8d963 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f808f41-e5b2-40e0-8754-44da6d2f0a57 (dataset): DatasetConfig { id: 8f808f41-e5b2-40e0-8754-44da6d2f0a57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 940481ba-666b-458a-ab82-a0031905bc39 (dataset): DatasetConfig { id: 940481ba-666b-458a-ab82-a0031905bc39 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e04e88-7cc5-43e8-aa9f-dd2679bcae91 (dataset): DatasetConfig { id: 96e04e88-7cc5-43e8-aa9f-dd2679bcae91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 998c4bf6-0665-4ae2-bada-296b26e58512 (dataset): DatasetConfig { id: 998c4bf6-0665-4ae2-bada-296b26e58512 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9a497610-c462-4453-83c6-2025b957d220 (dataset): DatasetConfig { id: 9a497610-c462-4453-83c6-2025b957d220 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9f0c98-a931-4716-93f7-4c9f0e43fa99 (dataset): DatasetConfig { id: 9c9f0c98-a931-4716-93f7-4c9f0e43fa99 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fbd91e3-4755-4dac-a868-22006cf0bd79 (dataset): DatasetConfig { id: 9fbd91e3-4755-4dac-a868-22006cf0bd79 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0207af7-f2b8-457a-917f-8db7287fed95 (dataset): DatasetConfig { id: a0207af7-f2b8-457a-917f-8db7287fed95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5c7b89b-bfe0-4c66-930e-aaec4367b924 (dataset): DatasetConfig { id: a5c7b89b-bfe0-4c66-930e-aaec4367b924 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abbfba9b-cb73-42ce-9ff9-c5dd6d1c4503 (dataset): DatasetConfig { id: abbfba9b-cb73-42ce-9ff9-c5dd6d1c4503 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad6b96f0-fcfa-4142-9746-222bab231d28 (dataset): DatasetConfig { id: ad6b96f0-fcfa-4142-9746-222bab231d28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b877c11a-4fbc-4cce-8331-7d691d03fbb0 (dataset): DatasetConfig { id: b877c11a-4fbc-4cce-8331-7d691d03fbb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8ab226f-ad21-4144-a85f-b2fed92101ad (dataset): DatasetConfig { id: b8ab226f-ad21-4144-a85f-b2fed92101ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d9db61-dcfb-4685-8738-5d2ad22422a5 (dataset): DatasetConfig { id: b9d9db61-dcfb-4685-8738-5d2ad22422a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c02b18fd-1a6c-49c0-b204-bc19d01c6d6d (dataset): DatasetConfig { id: c02b18fd-1a6c-49c0-b204-bc19d01c6d6d (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c11ca2d1-6ff8-4cb1-bfaa-7aa0b467e67b (dataset): DatasetConfig { id: c11ca2d1-6ff8-4cb1-bfaa-7aa0b467e67b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c27d9f57-be08-4c68-8fa4-be7d8429a051 (dataset): DatasetConfig { id: c27d9f57-be08-4c68-8fa4-be7d8429a051 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2ababc4-be64-4ce4-a111-6f70408a0801 (dataset): DatasetConfig { id: c2ababc4-be64-4ce4-a111-6f70408a0801 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7a00cac-7eae-43a1-91a3-8306fd5a9981 (dataset): DatasetConfig { id: c7a00cac-7eae-43a1-91a3-8306fd5a9981 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9a39b7c-3f4b-47e8-bdaa-a22ad8cb73d3 (dataset): DatasetConfig { id: c9a39b7c-3f4b-47e8-bdaa-a22ad8cb73d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6cb342c-d4ca-4d75-9191-5b5ee6088859 (dataset): DatasetConfig { id: d6cb342c-d4ca-4d75-9191-5b5ee6088859 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8cc9163-3df1-4c6f-9bfa-2e9efa4a8a9c (dataset): DatasetConfig { id: d8cc9163-3df1-4c6f-9bfa-2e9efa4a8a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d1c7ad-3513-49a4-8364-3a452fa5bd23 (dataset): DatasetConfig { id: d9d1c7ad-3513-49a4-8364-3a452fa5bd23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dba81c4f-9f35-4703-9845-b0afaef1d5fd (dataset): DatasetConfig { id: dba81c4f-9f35-4703-9845-b0afaef1d5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df1fcc15-5f9f-45b3-9556-d2bf03b8c634 (dataset): DatasetConfig { id: df1fcc15-5f9f-45b3-9556-d2bf03b8c634 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef3c16bc-753e-4c5c-a6b7-d0143995ae77 (dataset): DatasetConfig { id: ef3c16bc-753e-4c5c-a6b7-d0143995ae77 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f214a366-6864-4a61-9d9f-abf207784d70 (dataset): DatasetConfig { id: f214a366-6864-4a61-9d9f-abf207784d70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6845a36-9719-430c-9f44-10dd4b034ca3 (dataset): DatasetConfig { id: f6845a36-9719-430c-9f44-10dd4b034ca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6d4653a-d56f-4f4a-8793-cb0ddb19546e (dataset): DatasetConfig { id: f6d4653a-d56f-4f4a-8793-cb0ddb19546e (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d97d0e-dc29-43cd-83f3-fa9e17deee2a (dataset): DatasetConfig { id: f8d97d0e-dc29-43cd-83f3-fa9e17deee2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4472025-01-13T22:40:39.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46939
4482025-01-13T22:40:39.680ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4492025-01-13T22:40:39.680ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01498782-306b-4b92-8f64-5eb4db7e013c (dataset): DatasetConfig { id: 01498782-306b-4b92-8f64-5eb4db7e013c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 02ab6fbb-c726-4799-a32c-60f38f1c06c1 (dataset): DatasetConfig { id: 02ab6fbb-c726-4799-a32c-60f38f1c06c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 039224a8-f0b9-4ae1-a9c5-d52348c16fb1 (dataset): DatasetConfig { id: 039224a8-f0b9-4ae1-a9c5-d52348c16fb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 058be9db-981a-40c9-a985-921524886dac (dataset): DatasetConfig { id: 058be9db-981a-40c9-a985-921524886dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 059df9d3-2b41-443c-be67-e410afb9ee46 (dataset): DatasetConfig { id: 059df9d3-2b41-443c-be67-e410afb9ee46 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1121b13a-fdcf-46f2-bdb1-987403c011e0 (dataset): DatasetConfig { id: 1121b13a-fdcf-46f2-bdb1-987403c011e0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 119719b6-85d1-4408-b8cd-5d4541c9db31 (dataset): DatasetConfig { id: 119719b6-85d1-4408-b8cd-5d4541c9db31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 19594402-3352-47d4-9949-6b95814d77db (dataset): DatasetConfig { id: 19594402-3352-47d4-9949-6b95814d77db (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e56e2f0-afb4-466d-a4f6-866868e27f17 (dataset): DatasetConfig { id: 1e56e2f0-afb4-466d-a4f6-866868e27f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f306c66-6a41-4ebd-9388-18fe40af2bea (dataset): DatasetConfig { id: 1f306c66-6a41-4ebd-9388-18fe40af2bea (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 241a1ea3-513e-493e-b81f-cccecd394c3d (dataset): DatasetConfig { id: 241a1ea3-513e-493e-b81f-cccecd394c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24db753e-8595-4e81-87e7-11cf77e075cd (dataset): DatasetConfig { id: 24db753e-8595-4e81-87e7-11cf77e075cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2592c8b2-9ff3-4f32-be3f-444389f96dec (dataset): DatasetConfig { id: 2592c8b2-9ff3-4f32-be3f-444389f96dec (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27fb7d2c-f5b4-4703-8c31-0a5a621d1c1d (dataset): DatasetConfig { id: 27fb7d2c-f5b4-4703-8c31-0a5a621d1c1d (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a6af61d-1447-428f-af2f-152399e8d391 (dataset): DatasetConfig { id: 2a6af61d-1447-428f-af2f-152399e8d391 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 30224445-7cde-4601-b291-a0f653ee0c8e (dataset): DatasetConfig { id: 30224445-7cde-4601-b291-a0f653ee0c8e (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 36647c6d-0c7c-4dba-a2db-ca6420155332 (dataset): DatasetConfig { id: 36647c6d-0c7c-4dba-a2db-ca6420155332 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 374c3468-5e40-4b4c-a3c8-4ce354483760 (dataset): DatasetConfig { id: 374c3468-5e40-4b4c-a3c8-4ce354483760 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3946e8d9-5f80-4699-bbfa-61dd5071cb4a (dataset): DatasetConfig { id: 3946e8d9-5f80-4699-bbfa-61dd5071cb4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3b0ea56a-a889-4b60-bf95-e7e524e05e51 (dataset): DatasetConfig { id: 3b0ea56a-a889-4b60-bf95-e7e524e05e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3c46b1b2-9b87-4ca1-80cc-4a3efc2942b3 (dataset): DatasetConfig { id: 3c46b1b2-9b87-4ca1-80cc-4a3efc2942b3 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e7448f2-453f-4e91-9925-7bfbfcf6025d (dataset): DatasetConfig { id: 3e7448f2-453f-4e91-9925-7bfbfcf6025d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af02f24-6295-42f5-9958-ab9baf5e6004 (dataset): DatasetConfig { id: 4af02f24-6295-42f5-9958-ab9baf5e6004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 55d7cb87-8b6d-4980-844e-1307d65224b4 (dataset): DatasetConfig { id: 55d7cb87-8b6d-4980-844e-1307d65224b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 565189d7-b48b-4c47-993f-5c78b5fcff6d (dataset): DatasetConfig { id: 565189d7-b48b-4c47-993f-5c78b5fcff6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cb76e8b-66d8-45e3-bb88-e0d6304fa4c6 (dataset): DatasetConfig { id: 5cb76e8b-66d8-45e3-bb88-e0d6304fa4c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e2bab1f-2347-4430-bac3-b9fb72129dc9 (dataset): DatasetConfig { id: 5e2bab1f-2347-4430-bac3-b9fb72129dc9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61a995b6-a0d8-4d1c-b14e-df95392da06f (dataset): DatasetConfig { id: 61a995b6-a0d8-4d1c-b14e-df95392da06f (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69d421ea-992e-47e1-9cd7-876bcb9a6b1c (dataset): DatasetConfig { id: 69d421ea-992e-47e1-9cd7-876bcb9a6b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cf4dc29-133f-482c-8178-edcc88f16b0f (dataset): DatasetConfig { id: 6cf4dc29-133f-482c-8178-edcc88f16b0f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d7d3b72-336a-4e8e-941d-8a72d0c7eb1b (dataset): DatasetConfig { id: 6d7d3b72-336a-4e8e-941d-8a72d0c7eb1b (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 74b3941b-fb8e-42a8-96a7-d2592a4c294f (dataset): DatasetConfig { id: 74b3941b-fb8e-42a8-96a7-d2592a4c294f (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7a30d896-96a2-440c-ba76-67713fd15873 (dataset): DatasetConfig { id: 7a30d896-96a2-440c-ba76-67713fd15873 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e43eab7-78b6-424e-a84e-cdfd8e2a57f0 (dataset): DatasetConfig { id: 7e43eab7-78b6-424e-a84e-cdfd8e2a57f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 863d99c6-9c5d-411f-9ae4-aed014b4888a (dataset): DatasetConfig { id: 863d99c6-9c5d-411f-9ae4-aed014b4888a (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d13dfed-a840-427f-9248-c80fe9c8d963 (dataset): DatasetConfig { id: 8d13dfed-a840-427f-9248-c80fe9c8d963 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f808f41-e5b2-40e0-8754-44da6d2f0a57 (dataset): DatasetConfig { id: 8f808f41-e5b2-40e0-8754-44da6d2f0a57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 940481ba-666b-458a-ab82-a0031905bc39 (dataset): DatasetConfig { id: 940481ba-666b-458a-ab82-a0031905bc39 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e04e88-7cc5-43e8-aa9f-dd2679bcae91 (dataset): DatasetConfig { id: 96e04e88-7cc5-43e8-aa9f-dd2679bcae91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 998c4bf6-0665-4ae2-bada-296b26e58512 (dataset): DatasetConfig { id: 998c4bf6-0665-4ae2-bada-296b26e58512 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9a497610-c462-4453-83c6-2025b957d220 (dataset): DatasetConfig { id: 9a497610-c462-4453-83c6-2025b957d220 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c9f0c98-a931-4716-93f7-4c9f0e43fa99 (dataset): DatasetConfig { id: 9c9f0c98-a931-4716-93f7-4c9f0e43fa99 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fbd91e3-4755-4dac-a868-22006cf0bd79 (dataset): DatasetConfig { id: 9fbd91e3-4755-4dac-a868-22006cf0bd79 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0207af7-f2b8-457a-917f-8db7287fed95 (dataset): DatasetConfig { id: a0207af7-f2b8-457a-917f-8db7287fed95 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5c7b89b-bfe0-4c66-930e-aaec4367b924 (dataset): DatasetConfig { id: a5c7b89b-bfe0-4c66-930e-aaec4367b924 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, abbfba9b-cb73-42ce-9ff9-c5dd6d1c4503 (dataset): DatasetConfig { id: abbfba9b-cb73-42ce-9ff9-c5dd6d1c4503 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad6b96f0-fcfa-4142-9746-222bab231d28 (dataset): DatasetConfig { id: ad6b96f0-fcfa-4142-9746-222bab231d28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b877c11a-4fbc-4cce-8331-7d691d03fbb0 (dataset): DatasetConfig { id: b877c11a-4fbc-4cce-8331-7d691d03fbb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b8ab226f-ad21-4144-a85f-b2fed92101ad (dataset): DatasetConfig { id: b8ab226f-ad21-4144-a85f-b2fed92101ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9d9db61-dcfb-4685-8738-5d2ad22422a5 (dataset): DatasetConfig { id: b9d9db61-dcfb-4685-8738-5d2ad22422a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c02b18fd-1a6c-49c0-b204-bc19d01c6d6d (dataset): DatasetConfig { id: c02b18fd-1a6c-49c0-b204-bc19d01c6d6d (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c11ca2d1-6ff8-4cb1-bfaa-7aa0b467e67b (dataset): DatasetConfig { id: c11ca2d1-6ff8-4cb1-bfaa-7aa0b467e67b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c27d9f57-be08-4c68-8fa4-be7d8429a051 (dataset): DatasetConfig { id: c27d9f57-be08-4c68-8fa4-be7d8429a051 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2ababc4-be64-4ce4-a111-6f70408a0801 (dataset): DatasetConfig { id: c2ababc4-be64-4ce4-a111-6f70408a0801 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7a00cac-7eae-43a1-91a3-8306fd5a9981 (dataset): DatasetConfig { id: c7a00cac-7eae-43a1-91a3-8306fd5a9981 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c9a39b7c-3f4b-47e8-bdaa-a22ad8cb73d3 (dataset): DatasetConfig { id: c9a39b7c-3f4b-47e8-bdaa-a22ad8cb73d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6cb342c-d4ca-4d75-9191-5b5ee6088859 (dataset): DatasetConfig { id: d6cb342c-d4ca-4d75-9191-5b5ee6088859 (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8cc9163-3df1-4c6f-9bfa-2e9efa4a8a9c (dataset): DatasetConfig { id: d8cc9163-3df1-4c6f-9bfa-2e9efa4a8a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d1c7ad-3513-49a4-8364-3a452fa5bd23 (dataset): DatasetConfig { id: d9d1c7ad-3513-49a4-8364-3a452fa5bd23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dba81c4f-9f35-4703-9845-b0afaef1d5fd (dataset): DatasetConfig { id: dba81c4f-9f35-4703-9845-b0afaef1d5fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df1fcc15-5f9f-45b3-9556-d2bf03b8c634 (dataset): DatasetConfig { id: df1fcc15-5f9f-45b3-9556-d2bf03b8c634 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ef3c16bc-753e-4c5c-a6b7-d0143995ae77 (dataset): DatasetConfig { id: ef3c16bc-753e-4c5c-a6b7-d0143995ae77 (dataset), name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f214a366-6864-4a61-9d9f-abf207784d70 (dataset): DatasetConfig { id: f214a366-6864-4a61-9d9f-abf207784d70 (dataset), name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6845a36-9719-430c-9f44-10dd4b034ca3 (dataset): DatasetConfig { id: f6845a36-9719-430c-9f44-10dd4b034ca3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6d4653a-d56f-4f4a-8793-cb0ddb19546e (dataset): DatasetConfig { id: f6d4653a-d56f-4f4a-8793-cb0ddb19546e (dataset), name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8d97d0e-dc29-43cd-83f3-fa9e17deee2a (dataset): DatasetConfig { id: f8d97d0e-dc29-43cd-83f3-fa9e17deee2a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4502025-01-13T22:40:39.680ZINFOSledAgent (StorageManager): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-13T22:40:39.680ZINFOSledAgent (StorageManager): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4522025-01-13T22:40:39.680ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4532025-01-13T22:40:39.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-01-13T22:40:39.695ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4552025-01-13T22:40:39.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/debug"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/debug" } file = sled-storage/src/manager.rs:1431
4562025-01-13T22:40:39.722ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-01-13T22:40:39.722ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-01-13T22:40:39.722ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crucible" } file = sled-storage/src/manager.rs:1431
4592025-01-13T22:40:39.770ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-01-13T22:40:39.770ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-01-13T22:40:39.770ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174" } file = sled-storage/src/manager.rs:1431
4622025-01-13T22:40:39.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-01-13T22:40:39.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642025-01-13T22:40:39.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4652025-01-13T22:40:39.873ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-13T22:40:39.873ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4672025-01-13T22:40:39.873ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone" } file = sled-storage/src/manager.rs:1431
4682025-01-13T22:40:39.903ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-01-13T22:40:39.903ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4702025-01-13T22:40:39.903ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4712025-01-13T22:40:39.929ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-13T22:40:39.929ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732025-01-13T22:40:39.929ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4" } file = sled-storage/src/manager.rs:1431
4742025-01-13T22:40:39.946ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
4752025-01-13T22:40:39.987ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-01-13T22:40:39.987ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772025-01-13T22:40:39.987ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crucible" } file = sled-storage/src/manager.rs:1431
4782025-01-13T22:40:40.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-13T22:40:40.032ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-01-13T22:40:40.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9260d14e-3165-43af-a297-8b2685485aec/crypt/zone/oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1"), full_name: "oxp_9260d14e-3165-43af-a297-8b2685485aec/crypt/zone/oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1" } file = sled-storage/src/manager.rs:1431
4812025-01-13T22:40:40.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-13T22:40:40.093ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-13T22:40:40.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4842025-01-13T22:40:40.142ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-13T22:40:40.142ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-13T22:40:40.142ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd" } file = sled-storage/src/manager.rs:1431
4872025-01-13T22:40:40.201ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-13T22:40:40.202ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4892025-01-13T22:40:40.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone"), full_name: "oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone" } file = sled-storage/src/manager.rs:1431
4902025-01-13T22:40:40.229ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-13T22:40:40.229ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-01-13T22:40:40.229ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crucible" } file = sled-storage/src/manager.rs:1431
4932025-01-13T22:40:40.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-13T22:40:40.276ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-01-13T22:40:40.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327" } file = sled-storage/src/manager.rs:1431
4962025-01-13T22:40:40.333ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-13T22:40:40.333ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4982025-01-13T22:40:40.333ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/debug"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/debug" } file = sled-storage/src/manager.rs:1431
4992025-01-13T22:40:40.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-13T22:40:40.361ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5012025-01-13T22:40:40.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone" } file = sled-storage/src/manager.rs:1431
5022025-01-13T22:40:40.388ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-01-13T22:40:40.388ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-01-13T22:40:40.388ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5052025-01-13T22:40:40.435ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-01-13T22:40:40.435ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072025-01-13T22:40:40.435ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7" } file = sled-storage/src/manager.rs:1431
5082025-01-13T22:40:40.492ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-01-13T22:40:40.492ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102025-01-13T22:40:40.492ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crucible" } file = sled-storage/src/manager.rs:1431
5112025-01-13T22:40:40.537ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-01-13T22:40:40.537ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5132025-01-13T22:40:40.537ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/debug"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5142025-01-13T22:40:40.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-01-13T22:40:40.564ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162025-01-13T22:40:40.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849" } file = sled-storage/src/manager.rs:1431
5172025-01-13T22:40:40.621ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-01-13T22:40:40.621ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192025-01-13T22:40:40.621ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5202025-01-13T22:40:40.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-01-13T22:40:40.670ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222025-01-13T22:40:40.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5232025-01-13T22:40:40.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-01-13T22:40:40.720ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-01-13T22:40:40.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone/oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone/oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156" } file = sled-storage/src/manager.rs:1431
5262025-01-13T22:40:40.776ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-13T22:40:40.776ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-01-13T22:40:40.776ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5292025-01-13T22:40:40.824ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-13T22:40:40.824ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5312025-01-13T22:40:40.824ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/debug"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/debug" } file = sled-storage/src/manager.rs:1431
5322025-01-13T22:40:40.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-13T22:40:40.853ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-13T22:40:40.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone/oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e" } file = sled-storage/src/manager.rs:1431
5352025-01-13T22:40:40.909ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-13T22:40:40.909ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-13T22:40:40.909ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crucible" } file = sled-storage/src/manager.rs:1431
5382025-01-13T22:40:40.947ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
5392025-01-13T22:40:40.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402025-01-13T22:40:40.955ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5412025-01-13T22:40:40.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone/oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d"), full_name: "oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone/oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d" } file = sled-storage/src/manager.rs:1431
5422025-01-13T22:40:41.012ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-13T22:40:41.012ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442025-01-13T22:40:41.012ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef" } file = sled-storage/src/manager.rs:1431
5452025-01-13T22:40:41.079ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-13T22:40:41.079ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472025-01-13T22:40:41.079ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/debug"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/debug" } file = sled-storage/src/manager.rs:1431
5482025-01-13T22:40:41.110ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-13T22:40:41.110ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5502025-01-13T22:40:41.110ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/debug"), full_name: "oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/debug" } file = sled-storage/src/manager.rs:1431
5512025-01-13T22:40:41.140ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-13T22:40:41.140ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532025-01-13T22:40:41.140ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crucible" } file = sled-storage/src/manager.rs:1431
5542025-01-13T22:40:41.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-13T22:40:41.189ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-01-13T22:40:41.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c" } file = sled-storage/src/manager.rs:1431
5572025-01-13T22:40:41.250ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-13T22:40:41.250ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-01-13T22:40:41.250ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb" } file = sled-storage/src/manager.rs:1431
5602025-01-13T22:40:41.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-13T22:40:41.310ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622025-01-13T22:40:41.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crucible" } file = sled-storage/src/manager.rs:1431
5632025-01-13T22:40:41.358ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-01-13T22:40:41.358ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5652025-01-13T22:40:41.358ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5662025-01-13T22:40:41.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-13T22:40:41.387ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-01-13T22:40:41.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4" } file = sled-storage/src/manager.rs:1431
5692025-01-13T22:40:41.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-13T22:40:41.445ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712025-01-13T22:40:41.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4"), full_name: "oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/zone/oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4" } file = sled-storage/src/manager.rs:1431
5722025-01-13T22:40:41.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-13T22:40:41.503ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5742025-01-13T22:40:41.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/debug"), full_name: "oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/debug" } file = sled-storage/src/manager.rs:1431
5752025-01-13T22:40:41.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-13T22:40:41.531ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-01-13T22:40:41.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crucible" } file = sled-storage/src/manager.rs:1431
5782025-01-13T22:40:41.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-13T22:40:41.580ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-13T22:40:41.580ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be" } file = sled-storage/src/manager.rs:1431
5812025-01-13T22:40:41.640ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-13T22:40:41.640ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832025-01-13T22:40:41.640ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5842025-01-13T22:40:41.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-13T22:40:41.689ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-13T22:40:41.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188" } file = sled-storage/src/manager.rs:1431
5872025-01-13T22:40:41.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-13T22:40:41.747ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-13T22:40:41.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be" } file = sled-storage/src/manager.rs:1431
5902025-01-13T22:40:41.806ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-13T22:40:41.807ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-01-13T22:40:41.807ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b" } file = sled-storage/src/manager.rs:1431
5932025-01-13T22:40:41.867ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-13T22:40:41.867ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5952025-01-13T22:40:41.867ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9260d14e-3165-43af-a297-8b2685485aec/crypt/debug"), full_name: "oxp_9260d14e-3165-43af-a297-8b2685485aec/crypt/debug" } file = sled-storage/src/manager.rs:1431
5962025-01-13T22:40:41.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-13T22:40:41.896ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982025-01-13T22:40:41.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/debug"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/debug" } file = sled-storage/src/manager.rs:1431
5992025-01-13T22:40:41.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-13T22:40:41.925ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-13T22:40:41.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone/oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7"), full_name: "oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone/oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7" } file = sled-storage/src/manager.rs:1431
6022025-01-13T22:40:41.950ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
6032025-01-13T22:40:41.984ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-13T22:40:41.984ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052025-01-13T22:40:41.984ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6062025-01-13T22:40:42.036ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-13T22:40:42.036ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-13T22:40:42.036ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/zone/oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15" } file = sled-storage/src/manager.rs:1431
6092025-01-13T22:40:42.098ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-13T22:40:42.098ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-01-13T22:40:42.098ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone/oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934"), full_name: "oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone/oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934" } file = sled-storage/src/manager.rs:1431
6122025-01-13T22:40:42.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-13T22:40:42.157ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-01-13T22:40:42.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9260d14e-3165-43af-a297-8b2685485aec/crucible" } file = sled-storage/src/manager.rs:1431
6152025-01-13T22:40:42.204ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-13T22:40:42.204ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-13T22:40:42.204ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff" } file = sled-storage/src/manager.rs:1431
6182025-01-13T22:40:42.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-13T22:40:42.263ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-13T22:40:42.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9260d14e-3165-43af-a297-8b2685485aec/crypt/zone/oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a"), full_name: "oxp_9260d14e-3165-43af-a297-8b2685485aec/crypt/zone/oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a" } file = sled-storage/src/manager.rs:1431
6212025-01-13T22:40:42.323ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-13T22:40:42.323ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6232025-01-13T22:40:42.323ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone"), full_name: "oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/zone" } file = sled-storage/src/manager.rs:1431
6242025-01-13T22:40:42.353ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-13T22:40:42.353ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-01-13T22:40:42.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6272025-01-13T22:40:42.402ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-13T22:40:42.402ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6292025-01-13T22:40:42.402ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone" } file = sled-storage/src/manager.rs:1431
6302025-01-13T22:40:42.432ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-13T22:40:42.432ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322025-01-13T22:40:42.432ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone"), full_name: "oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/zone" } file = sled-storage/src/manager.rs:1431
6332025-01-13T22:40:42.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-13T22:40:42.461ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-01-13T22:40:42.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), full_name: "oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/zone/oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f" } file = sled-storage/src/manager.rs:1431
6362025-01-13T22:40:42.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-13T22:40:42.521ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-13T22:40:42.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6392025-01-13T22:40:42.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-13T22:40:42.571ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-13T22:40:42.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249"), full_name: "oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/zone/oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249" } file = sled-storage/src/manager.rs:1431
6422025-01-13T22:40:42.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-13T22:40:42.630ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-13T22:40:42.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone/oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), full_name: "oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/zone/oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b" } file = sled-storage/src/manager.rs:1431
6452025-01-13T22:40:42.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-13T22:40:42.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-01-13T22:40:42.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone/oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd"), full_name: "oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/zone/oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd" } file = sled-storage/src/manager.rs:1431
6482025-01-13T22:40:42.747ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-01-13T22:40:42.747ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-01-13T22:40:42.747ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6512025-01-13T22:40:42.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6522025-01-13T22:40:42.795ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6532025-01-13T22:40:42.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9260d14e-3165-43af-a297-8b2685485aec/crypt/zone"), full_name: "oxp_9260d14e-3165-43af-a297-8b2685485aec/crypt/zone" } file = sled-storage/src/manager.rs:1431
6542025-01-13T22:40:42.823ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-01-13T22:40:42.823ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562025-01-13T22:40:42.823ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
6572025-01-13T22:40:42.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3144231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46939 req_id = 40cc22c3-feb0-488d-9469-42784b05a327 response_code = 200 uri = /datasets
6582025-01-13T22:40:42.856ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: e682b62b-457a-4c56-8f10-146a56a0b849 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea1c6c62-6b91-4c2e-b341-59c749f0e249 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 703734af-afe4-469d-918d-477e69023a5c (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6592025-01-13T22:40:42.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44624
6602025-01-13T22:40:42.856ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-13T22:40:42.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-13T22:40:42.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632025-01-13T22:40:42.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642025-01-13T22:40:42.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6652025-01-13T22:40:42.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }
6662025-01-13T22:40:42.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-13T22:40:42.883ZINFOSledAgent (ServiceManager): No ledger in /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-01-13T22:40:42.883ZINFOSledAgent (ServiceManager): No ledger in /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:188
6692025-01-13T22:40:42.883ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-13T22:40:42.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-13T22:40:42.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-13T22:40:42.925ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-01-13T22:40:42.954ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
6742025-01-13T22:40:42.978ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249 file = illumos-utils/src/zone.rs:325
6752025-01-13T22:40:42.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c file = illumos-utils/src/zone.rs:325
6762025-01-13T22:40:42.986ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849 file = illumos-utils/src/zone.rs:325
6772025-01-13T22:40:42.997ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249 file = illumos-utils/src/zone.rs:363
6782025-01-13T22:40:43.003ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c file = illumos-utils/src/zone.rs:363
6792025-01-13T22:40:43.007ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849 file = illumos-utils/src/zone.rs:363
6802025-01-13T22:40:43.067ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
6812025-01-13T22:40:43.067ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
6822025-01-13T22:40:43.957ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/bd8d50a3-f530-430e-8ded-11b6657cae3b) file = sled-agent/src/probe_manager.rs:231 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
6832025-01-13T22:40:44.618ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842025-01-13T22:40:44.618ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6852025-01-13T22:40:45.099ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6862025-01-13T22:40:45.099ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
6872025-01-13T22:40:45.104ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6882025-01-13T22:40:45.132ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
6892025-01-13T22:40:45.132ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
6902025-01-13T22:40:45.153ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6912025-01-13T22:40:45.153ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6922025-01-13T22:40:45.224ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6932025-01-13T22:40:45.225ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6942025-01-13T22:40:45.335ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6952025-01-13T22:40:45.335ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6962025-01-13T22:40:45.579ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 36.596593ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6972025-01-13T22:40:45.591ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6982025-01-13T22:40:45.591ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
6992025-01-13T22:40:45.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 66.441973ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7002025-01-13T22:40:45.604ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7012025-01-13T22:40:45.604ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7022025-01-13T22:40:45.617ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 112.008535ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7032025-01-13T22:40:45.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 74.616178ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7042025-01-13T22:40:45.716ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
7052025-01-13T22:40:45.717ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
7062025-01-13T22:40:45.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 33.335622ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7072025-01-13T22:40:45.731ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7082025-01-13T22:40:45.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 61.701276ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7092025-01-13T22:40:45.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 227.291648ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7102025-01-13T22:40:45.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 79.858756ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7112025-01-13T22:40:45.773ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7122025-01-13T22:40:45.773ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7132025-01-13T22:40:45.773ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7142025-01-13T22:40:45.773ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7152025-01-13T22:40:45.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 126.888689ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7162025-01-13T22:40:45.908ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7172025-01-13T22:40:45.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 106.518924ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7182025-01-13T22:40:46.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 232.799246ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7192025-01-13T22:40:46.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 409.750566ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7202025-01-13T22:40:46.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 561.167811ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7212025-01-13T22:40:46.106ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7222025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-01-13T22:40:46.106ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442025-01-13T22:40:46.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 387.419329ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7452025-01-13T22:40:46.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 479.944463ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7462025-01-13T22:40:46.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
7472025-01-13T22:40:46.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
7482025-01-13T22:40:46.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 972.712947ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7492025-01-13T22:40:46.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 898.651702ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7502025-01-13T22:40:46.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 1.080147663s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7512025-01-13T22:40:47.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 1.079787438s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7522025-01-13T22:40:47.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 1.391864745s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7532025-01-13T22:40:48.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 694.502814ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7542025-01-13T22:40:48.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 1.117572204s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7552025-01-13T22:40:48.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 842.596339ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7562025-01-13T22:40:49.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849") failed: Property not found. retry in 1.294277934s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7572025-01-13T22:40:49.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c") failed: Property not found. retry in 1.256677769s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7582025-01-13T22:40:49.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249") failed: Property not found. retry in 1.294394199s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7592025-01-13T22:40:51.122ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_ea1c6c62-6b91-4c2e-b341-59c749f0e249
7602025-01-13T22:40:51.122ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_703734af-afe4-469d-918d-477e69023a5c
7612025-01-13T22:40:51.122ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_e682b62b-457a-4c56-8f10-146a56a0b849
7622025-01-13T22:40:51.122ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-13T22:40:51.123ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-13T22:40:51.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8266727 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44624 req_id = eda06f4b-4e1b-4900-9983-43b6e336dbc8 response_code = 204 uri = /omicron-zones
7652025-01-13T22:40:51.125ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662025-01-13T22:40:51.225ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 147.282867ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7672025-01-13T22:40:51.389ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-13T22:40:51.509ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 136.627707ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7692025-01-13T22:40:51.665ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-13T22:40:51.712ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7712025-01-13T22:40:51.712ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7722025-01-13T22:40:51.745ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7732025-01-13T22:40:51.746ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7742025-01-13T22:40:51.746ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7752025-01-13T22:40:51.775ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: e682b62b-457a-4c56-8f10-146a56a0b849 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea1c6c62-6b91-4c2e-b341-59c749f0e249 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 703734af-afe4-469d-918d-477e69023a5c (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 (service), filesystem_pool: Some(ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 710e4c04-7e00-484c-bf02-f33f32105faf, kind: Service { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 }, name: Name("ntp-8db144c1-4533-4677-9edb-91f1abba0ad7"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 84])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7762025-01-13T22:40:51.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43234
7772025-01-13T22:40:51.775ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-01-13T22:40:51.775ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-01-13T22:40:51.786ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-01-13T22:40:51.786ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-01-13T22:40:51.794ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-01-13T22:40:51.794ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-01-13T22:40:51.804ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-01-13T22:40:51.804ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
7852025-01-13T22:40:51.804ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
7862025-01-13T22:40:51.804ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-01-13T22:40:51.815ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7882025-01-13T22:40:51.846ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7892025-01-13T22:40:51.847ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7902025-01-13T22:40:51.847ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7912025-01-13T22:40:51.877ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 199, 84]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7922025-01-13T22:40:51.877ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7932025-01-13T22:40:51.878ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7942025-01-13T22:40:51.878ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7952025-01-13T22:40:51.878ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7962025-01-13T22:40:51.879ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7972025-01-13T22:40:51.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7 file = illumos-utils/src/zone.rs:325
7982025-01-13T22:40:51.921ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7 file = illumos-utils/src/zone.rs:363
7992025-01-13T22:40:52.589ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002025-01-13T22:40:52.589ZINFOSledAgent (ServiceManager): Booting oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8012025-01-13T22:40:52.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 50.699607ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8022025-01-13T22:40:52.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 131.056481ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8032025-01-13T22:40:52.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 238.039341ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8042025-01-13T22:40:53.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 422.716246ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8052025-01-13T22:40:53.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 923.788517ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8062025-01-13T22:40:54.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 658.459646ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8072025-01-13T22:40:55.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 659.403523ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8082025-01-13T22:40:55.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8092025-01-13T22:40:55.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8102025-01-13T22:40:55.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 541.115168ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8112025-01-13T22:40:56.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 670.56622ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8122025-01-13T22:40:56.635ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8132025-01-13T22:40:56.636ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8142025-01-13T22:40:57.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7") failed: Property not found. retry in 1.094439472s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8152025-01-13T22:40:58.224ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7
8162025-01-13T22:40:58.224ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-13T22:40:58.224ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-13T22:40:58.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6449300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43234 req_id = 9a8046e3-0c02-4155-9ec3-524003bdc947 response_code = 204 uri = /omicron-zones
8192025-01-13T22:40:58.227ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8202025-01-13T22:40:58.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212025-01-13T22:40:58.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55491
8222025-01-13T22:40:58.266ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8232025-01-13T22:40:58.266ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7597 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55491 req_id = 606bb656-a4ee-4566-9b88-96bebe5a9a3b response_code = 500 uri = /timesync
8242025-01-13T22:40:58.268ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252025-01-13T22:40:58.356ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-01-13T22:40:58.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63359
8272025-01-13T22:41:00.356ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8282025-01-13T22:41:00.364ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8292025-01-13T22:41:00.364ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 2008124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63359 req_id = 320cb7f7-ec6d-4602-84a0-db9de1f8e651 response_code = 500 uri = /timesync
8302025-01-13T22:41:00.367ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312025-01-13T22:41:00.532ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-01-13T22:41:00.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57297
8332025-01-13T22:41:00.541ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8342025-01-13T22:41:00.541ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57297 req_id = 0cf5e95d-1b20-4f66-ad34-5a6f6a367eb7 response_code = 500 uri = /timesync
8352025-01-13T22:41:00.542ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-13T22:41:00.745ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-01-13T22:41:00.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34975
8382025-01-13T22:41:00.752ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8392025-01-13T22:41:00.752ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34975 req_id = 0f17b637-e946-4389-969d-359e97f3b113 response_code = 500 uri = /timesync
8402025-01-13T22:41:00.754ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-01-13T22:41:00.883ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-01-13T22:41:00.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35698
8432025-01-13T22:41:02.892ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8442025-01-13T22:41:02.892ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 2008735 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35698 req_id = 67d437cf-00a2-4254-b768-f091c6c77445 response_code = 500 uri = /timesync
8452025-01-13T22:41:02.894ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8462025-01-13T22:41:02.894ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8472025-01-13T22:41:02.896ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-13T22:41:03.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-13T22:41:03.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36736
8502025-01-13T22:41:03.061ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8db144c1-4533-4677-9edb-91f1abba0ad7': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8512025-01-13T22:41:03.061ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8678 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36736 req_id = 4870b101-0ec3-4db2-9c4b-9a6df07c9f53 response_code = 500 uri = /timesync
8522025-01-13T22:41:03.063ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-13T22:41:03.291ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-13T22:41:03.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56171
8552025-01-13T22:41:05.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56171 req_id = 7032d7ae-a819-42c4-856c-1e73980df47d response_code = 200 uri = /timesync
8562025-01-13T22:41:05.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-13T22:41:05.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-13T22:41:05.558ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-13T22:41:05.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51037
8602025-01-13T22:41:05.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51037 req_id = 2df282e1-f452-4460-8b05-3a0d0faaa493 response_code = 200 uri = /timesync
8612025-01-13T22:41:05.570ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-13T22:41:05.570ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-01-13T22:41:06.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8642025-01-13T22:41:06.127ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8652025-01-13T22:41:06.208ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662025-01-13T22:41:06.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55998
8672025-01-13T22:41:06.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55998 req_id = d842660c-c4ce-4efd-975e-b79350b3a8af response_code = 200 uri = /timesync
8682025-01-13T22:41:06.219ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8692025-01-13T22:41:06.219ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702025-01-13T22:41:06.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712025-01-13T22:41:06.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44807
8722025-01-13T22:41:06.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44807 req_id = 59558307-7d07-43c4-8868-be14b165588f response_code = 200 uri = /timesync
8732025-01-13T22:41:06.636ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8742025-01-13T22:41:06.636ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752025-01-13T22:41:07.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8762025-01-13T22:41:07.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8772025-01-13T22:41:07.252ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782025-01-13T22:41:07.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60447
8792025-01-13T22:41:07.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8877 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60447 req_id = c52ad78d-c20b-491a-af9f-1acdae69308c response_code = 200 uri = /timesync
8802025-01-13T22:41:07.263ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8812025-01-13T22:41:07.263ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822025-01-13T22:41:08.085ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832025-01-13T22:41:08.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64662
8842025-01-13T22:41:08.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7484 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64662 req_id = 1e038e34-2de0-45b4-a324-c26a70f18fb2 response_code = 200 uri = /timesync
8852025-01-13T22:41:08.094ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808067.843598, correction: -0.161633179 } file = sled-agent/src/rack_setup/service.rs:743
8862025-01-13T22:41:08.094ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872025-01-13T22:41:08.623ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 535441142454252706 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8882025-01-13T22:41:08.623ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9755068617372253620 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
8892025-01-13T22:41:09.221ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902025-01-13T22:41:09.221ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58887
8912025-01-13T22:41:09.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7928 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58887 req_id = 7b431ee6-f66b-4b41-a11e-50fd32b2f6b1 response_code = 200 uri = /timesync
8922025-01-13T22:41:09.231ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736808067.1123974, correction: -0.161106527 } file = sled-agent/src/rack_setup/service.rs:743
8932025-01-13T22:41:09.231ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942025-01-13T22:41:09.822ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8952025-01-13T22:41:09.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62179
8962025-01-13T22:41:09.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62179 req_id = 8168eb2f-cb7d-430b-8590-4236eadf5c33 response_code = 200 uri = /timesync
8972025-01-13T22:41:09.831ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736808067.1123974, correction: -0.159475073 } file = sled-agent/src/rack_setup/service.rs:743
8982025-01-13T22:41:09.831ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992025-01-13T22:41:10.748ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9002025-01-13T22:41:11.087ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9012025-01-13T22:41:11.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46281
9022025-01-13T22:41:11.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46281 req_id = cfde362d-e75f-4254-8d3c-fbf8c3953dff response_code = 200 uri = /timesync
9032025-01-13T22:41:11.099ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736808067.1123974, correction: -0.156633556 } file = sled-agent/src/rack_setup/service.rs:743
9042025-01-13T22:41:11.099ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9052025-01-13T22:41:12.851ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062025-01-13T22:41:12.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37499
9072025-01-13T22:41:12.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8409 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37499 req_id = 5c176766-761d-4907-ac6d-ea21274412c0 response_code = 200 uri = /timesync
9082025-01-13T22:41:12.863ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736808067.1123974, correction: -0.151913151 } file = sled-agent/src/rack_setup/service.rs:743
9092025-01-13T22:41:12.863ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102025-01-13T22:41:13.279ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9112025-01-13T22:41:13.280ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9122025-01-13T22:41:13.749ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9132025-01-13T22:41:13.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54408
9142025-01-13T22:41:13.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7863 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54408 req_id = f13ecbd3-3894-40a6-abd0-35e638bf7364 response_code = 200 uri = /timesync
9152025-01-13T22:41:13.759ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736808067.1123974, correction: -0.149500459 } file = sled-agent/src/rack_setup/service.rs:743
9162025-01-13T22:41:13.759ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9172025-01-13T22:41:15.174ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9182025-01-13T22:41:15.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41449
9192025-01-13T22:41:15.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41449 req_id = 951983e0-183a-44d7-9ffb-89f66dabfa8a response_code = 200 uri = /timesync
9202025-01-13T22:41:15.184ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808074.1464863, correction: -0.144985363 } file = sled-agent/src/rack_setup/service.rs:743
9212025-01-13T22:41:15.184ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9222025-01-13T22:41:16.097ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9232025-01-13T22:41:16.097ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9242025-01-13T22:41:16.173ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56453
9252025-01-13T22:41:16.173ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56453 req_id = f143fc84-ce46-4924-b194-69e0e44fbe32 response_code = 200 uri = /baseboard
9262025-01-13T22:41:17.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9272025-01-13T22:41:17.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9282025-01-13T22:41:17.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292025-01-13T22:41:17.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33957
9302025-01-13T22:41:17.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33957 req_id = b73e5b9a-f279-4d7f-aebb-ef367f747d30 response_code = 200 uri = /timesync
9312025-01-13T22:41:17.707ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808076.856275, correction: -0.138076872 } file = sled-agent/src/rack_setup/service.rs:743
9322025-01-13T22:41:17.707ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9332025-01-13T22:41:18.299ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 341.904995ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9342025-01-13T22:41:18.599ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 535441142454252706 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9352025-01-13T22:41:18.599ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9755068617372253620 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9362025-01-13T22:41:20.268ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9372025-01-13T22:41:20.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61261
9382025-01-13T22:41:20.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9510 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61261 req_id = 329f94c1-f4b8-4627-b5c4-8f610414c8ad response_code = 200 uri = /timesync
9392025-01-13T22:41:20.281ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808079.3516903, correction: -0.131179616 } file = sled-agent/src/rack_setup/service.rs:743
9402025-01-13T22:41:20.281ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9412025-01-13T22:41:20.723ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9422025-01-13T22:41:22.413ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9432025-01-13T22:41:22.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52761
9442025-01-13T22:41:22.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8385 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52761 req_id = b5599df6-0e3e-45ad-84a3-d18ef2eeed5f response_code = 200 uri = /timesync
9452025-01-13T22:41:22.424ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808081.7477193, correction: -0.125372812 } file = sled-agent/src/rack_setup/service.rs:743
9462025-01-13T22:41:22.424ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9472025-01-13T22:41:23.254ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9482025-01-13T22:41:23.255ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9492025-01-13T22:41:26.059ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502025-01-13T22:41:26.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64342
9512025-01-13T22:41:26.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8758 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64342 req_id = 07c347c6-d783-47cb-b10a-d5d2ddbf11c2 response_code = 200 uri = /timesync
9522025-01-13T22:41:26.072ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808084.122897, correction: -0.115420215 } file = sled-agent/src/rack_setup/service.rs:743
9532025-01-13T22:41:26.072ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9542025-01-13T22:41:26.073ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9552025-01-13T22:41:26.073ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9562025-01-13T22:41:26.988ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9572025-01-13T22:41:26.988ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9582025-01-13T22:41:28.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 535441142454252706 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9592025-01-13T22:41:28.573ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9755068617372253620 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9602025-01-13T22:41:30.046ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9612025-01-13T22:41:30.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36319
9622025-01-13T22:41:30.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36319 req_id = 8850570a-ca6b-44d4-9044-b8237157c4db response_code = 200 uri = /timesync
9632025-01-13T22:41:30.057ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808088.350943, correction: -0.104591534 } file = sled-agent/src/rack_setup/service.rs:743
9642025-01-13T22:41:30.057ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9652025-01-13T22:41:30.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9662025-01-13T22:41:33.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9672025-01-13T22:41:33.229ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9682025-01-13T22:41:33.637ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 303.796636ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9692025-01-13T22:41:36.048ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 5200652768098864403 reason = Duration(60s) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9702025-01-13T22:41:36.048ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3177586145014568104 reason = Duration(60s) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9712025-01-13T22:41:36.620ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9722025-01-13T22:41:36.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46732
9732025-01-13T22:41:36.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9763 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46732 req_id = 6dee2354-e2a5-40fd-b0a5-cdbfe1ff9652 response_code = 200 uri = /timesync
9742025-01-13T22:41:36.632ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808095.1103904, correction: -0.086698472 } file = sled-agent/src/rack_setup/service.rs:743
9752025-01-13T22:41:36.632ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9762025-01-13T22:41:36.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9772025-01-13T22:41:36.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9782025-01-13T22:41:38.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 535441142454252706 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9792025-01-13T22:41:38.547ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9755068617372253620 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9802025-01-13T22:41:40.672ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9812025-01-13T22:41:43.204ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9822025-01-13T22:41:43.204ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9832025-01-13T22:41:46.126ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65089
9842025-01-13T22:41:46.126ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65089 req_id = 622fa098-6b61-400c-950d-cd53a07da064 response_code = 200 uri = /baseboard
9852025-01-13T22:41:46.526ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9862025-01-13T22:41:46.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33022
9872025-01-13T22:41:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9417 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33022 req_id = 5ed13f77-9d2b-49c7-86bc-41694e0c9bb2 response_code = 200 uri = /timesync
9882025-01-13T22:41:46.538ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808105.7221696, correction: -0.059783328 } file = sled-agent/src/rack_setup/service.rs:743
9892025-01-13T22:41:46.538ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9902025-01-13T22:41:46.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8547620745018997387 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9912025-01-13T22:41:46.938ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15191795901419359600 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9922025-01-13T22:41:48.522ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 535441142454252706 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9932025-01-13T22:41:48.522ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9755068617372253620 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9942025-01-13T22:41:48.936ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.199034267s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9952025-01-13T22:41:50.648ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 2519319650875972113 reason = Duration(60s) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9962025-01-13T22:41:53.179ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3982662394506378921 reason = Duration(60s) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9972025-01-13T22:41:53.179ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17176203778881852049 reason = Duration(60s) sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
9982025-01-13T22:41:53.248ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9992025-01-13T22:41:53.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39225
10002025-01-13T22:41:53.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39225 req_id = 0b617aad-20a5-47cd-a64f-4d0dae5e6b3a response_code = 200 uri = /timesync
10012025-01-13T22:41:53.269ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-13T22:41:36.047979332Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 5200652768098864403 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
10022025-01-13T22:41:53.271ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-13T22:41:50.648211824Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 2519319650875972113 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
10032025-01-13T22:41:53.272ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-13T22:41:36.048718565Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3177586145014568104 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
10042025-01-13T22:41:53.272ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-13T22:41:53.179259032Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3982662394506378921 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
10052025-01-13T22:41:53.272ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-13T22:41:53.179499880Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17176203778881852049 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
10062025-01-13T22:41:53.273ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 750650747, ip_addr: 44.190.5.123, stratum: 3, ref_time: 1736808109.5540276, correction: -0.041539732 } file = sled-agent/src/rack_setup/service.rs:743
10072025-01-13T22:41:53.273ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10082025-01-13T22:41:53.303ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: e682b62b-457a-4c56-8f10-146a56a0b849 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea1c6c62-6b91-4c2e-b341-59c749f0e249 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 703734af-afe4-469d-918d-477e69023a5c (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 (service), filesystem_pool: Some(ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 710e4c04-7e00-484c-bf02-f33f32105faf, kind: Service { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 }, name: Name("ntp-8db144c1-4533-4677-9edb-91f1abba0ad7"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 84])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 98a13b91-c9de-4224-9f66-1ba9750179be (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } } } }, OmicronZoneConfig { id: 603c176e-9d89-4099-ad42-bbbd6613b174 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } } } }, OmicronZoneConfig { id: d71379de-11dd-4f4f-9cf6-b8cd62627eef (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } } } }, OmicronZoneConfig { id: 3158eaae-69db-489a-b04a-5e1d16ff999b (service), filesystem_pool: Some(ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 21ccca49-da90-484a-8a83-c85f2ce5f156 (service), filesystem_pool: Some(ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10092025-01-13T22:41:53.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61495
10102025-01-13T22:41:53.303ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10112025-01-13T22:41:53.303ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10122025-01-13T22:41:53.314ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10132025-01-13T22:41:53.314ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10142025-01-13T22:41:53.323ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10152025-01-13T22:41:53.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }
10162025-01-13T22:41:53.333ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10172025-01-13T22:41:53.333ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10182025-01-13T22:41:53.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10192025-01-13T22:41:53.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10202025-01-13T22:41:53.352ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10212025-01-13T22:41:53.352ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222025-01-13T22:41:53.362ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10232025-01-13T22:41:53.362ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10242025-01-13T22:41:53.370ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10252025-01-13T22:41:53.370ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10262025-01-13T22:41:53.379ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10272025-01-13T22:41:53.379ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
10282025-01-13T22:41:53.379ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
10292025-01-13T22:41:53.380ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10302025-01-13T22:41:53.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10312025-01-13T22:41:53.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10322025-01-13T22:41:53.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10332025-01-13T22:41:53.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10342025-01-13T22:41:53.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10352025-01-13T22:41:53.552ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef file = illumos-utils/src/zone.rs:325
10362025-01-13T22:41:53.556ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be file = illumos-utils/src/zone.rs:325
10372025-01-13T22:41:53.560ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156 file = illumos-utils/src/zone.rs:325
10382025-01-13T22:41:53.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b file = illumos-utils/src/zone.rs:325
10392025-01-13T22:41:53.569ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174 file = illumos-utils/src/zone.rs:325
10402025-01-13T22:41:53.574ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef file = illumos-utils/src/zone.rs:363
10412025-01-13T22:41:53.579ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be file = illumos-utils/src/zone.rs:363
10422025-01-13T22:41:53.583ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156 file = illumos-utils/src/zone.rs:363
10432025-01-13T22:41:53.588ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b file = illumos-utils/src/zone.rs:363
10442025-01-13T22:41:53.592ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174 file = illumos-utils/src/zone.rs:363
10452025-01-13T22:41:56.480ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d71379de-11dd-4f4f-9cf6-b8cd62627eef'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10462025-01-13T22:41:56.480ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10472025-01-13T22:41:56.492ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='603c176e-9d89-4099-ad42-bbbd6613b174'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10482025-01-13T22:41:56.492ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10492025-01-13T22:41:56.571ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3158eaae-69db-489a-b04a-5e1d16ff999b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502025-01-13T22:41:56.571ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10512025-01-13T22:41:56.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 69.914227ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10522025-01-13T22:41:56.632ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='98a13b91-c9de-4224-9f66-1ba9750179be'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10532025-01-13T22:41:56.632ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10542025-01-13T22:41:56.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 47.177477ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10552025-01-13T22:41:56.648ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='21ccca49-da90-484a-8a83-c85f2ce5f156'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562025-01-13T22:41:56.649ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10572025-01-13T22:41:56.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 145.83112ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10582025-01-13T22:41:56.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 119.948884ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10592025-01-13T22:41:57.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 288.09042ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10602025-01-13T22:41:57.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 125.179028ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10612025-01-13T22:41:57.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 45.389076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10622025-01-13T22:41:57.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 328.337737ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10632025-01-13T22:41:57.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 378.115023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10642025-01-13T22:41:57.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 44.324665ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10652025-01-13T22:41:57.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 28.507917ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10662025-01-13T22:41:57.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 81.00179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10672025-01-13T22:41:57.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 109.790408ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10682025-01-13T22:41:57.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 80.99909ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10692025-01-13T22:41:57.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 153.365002ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10702025-01-13T22:41:57.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 268.395724ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10712025-01-13T22:41:58.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 119.508408ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10722025-01-13T22:41:58.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 595.493378ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10732025-01-13T22:41:58.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 442.073696ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10742025-01-13T22:41:58.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 547.630354ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10752025-01-13T22:41:58.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 490.196317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10762025-01-13T22:41:58.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 475.032026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10772025-01-13T22:41:58.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 618.04804ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10782025-01-13T22:41:58.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 513.848996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10792025-01-13T22:41:58.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 678.119824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10802025-01-13T22:41:58.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 750.208215ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10812025-01-13T22:41:58.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 974.913652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10822025-01-13T22:41:59.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 940.731431ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10832025-01-13T22:41:59.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 1.045040422s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10842025-01-13T22:41:59.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 602.917436ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10852025-01-13T22:41:59.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.448023865s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10862025-01-13T22:41:59.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.249264759s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10872025-01-13T22:41:59.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 898.411634ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10882025-01-13T22:42:00.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 1.28263695s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10892025-01-13T22:42:00.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 1.024721977s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10902025-01-13T22:42:00.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 747.949115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10912025-01-13T22:42:00.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.116247308s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10922025-01-13T22:42:00.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 684.876816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10932025-01-13T22:42:01.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 640.181646ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10942025-01-13T22:42:01.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 677.317394ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
10952025-01-13T22:42:01.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 842.624293ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
10962025-01-13T22:42:01.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 976.876636ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
10972025-01-13T22:42:01.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 1.209679065s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
10982025-01-13T22:42:02.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.012146639s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
10992025-01-13T22:42:02.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 501.364426ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
11002025-01-13T22:42:02.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.230381668s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11012025-01-13T22:42:02.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 578.315577ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
11022025-01-13T22:42:02.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 851.111454ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11032025-01-13T22:42:03.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 767.238336ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11042025-01-13T22:42:03.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 944.256486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
11052025-01-13T22:42:03.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 1.060923955s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
11062025-01-13T22:42:03.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 725.162486ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11072025-01-13T22:42:03.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 838.862577ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11082025-01-13T22:42:03.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.385864627s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11092025-01-13T22:42:04.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174") failed: Property not found. retry in 1.30613634s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
11102025-01-13T22:42:04.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.062304253s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11112025-01-13T22:42:04.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be") failed: Property not found. retry in 1.117099686s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
11122025-01-13T22:42:04.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 770.813663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11132025-01-13T22:42:05.127ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.861295237s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
11142025-01-13T22:42:05.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 808.737076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11152025-01-13T22:42:05.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.20390424s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11162025-01-13T22:42:05.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 732.951075ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11172025-01-13T22:42:06.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.46540321s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11182025-01-13T22:42:06.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 642.243522ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11192025-01-13T22:42:06.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 924.805068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11202025-01-13T22:42:06.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 906.720614ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11212025-01-13T22:42:07.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.040042969s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11222025-01-13T22:42:07.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 613.217197ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11232025-01-13T22:42:07.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.1371266s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11242025-01-13T22:42:08.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 656.352432ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11252025-01-13T22:42:08.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 814.782387ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11262025-01-13T22:42:08.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 689.517707ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11272025-01-13T22:42:08.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 936.697593ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11282025-01-13T22:42:09.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.006641034s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11292025-01-13T22:42:09.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 721.329763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11302025-01-13T22:42:09.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.337120002s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11312025-01-13T22:42:10.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 531.16279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11322025-01-13T22:42:10.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.027027567s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11332025-01-13T22:42:10.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.291505376s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11342025-01-13T22:42:11.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 546.860709ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11352025-01-13T22:42:11.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 989.982343ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11362025-01-13T22:42:11.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 861.419784ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11372025-01-13T22:42:12.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 554.700867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11382025-01-13T22:42:12.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.082052624s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11392025-01-13T22:42:12.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.307901346s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11402025-01-13T22:42:12.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 510.223088ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11412025-01-13T22:42:13.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.425627669s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11422025-01-13T22:42:13.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.231740096s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11432025-01-13T22:42:13.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 776.886653ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11442025-01-13T22:42:14.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef") failed: Property not found. retry in 1.196122411s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11452025-01-13T22:42:14.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156") failed: Property not found. retry in 1.226510234s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11462025-01-13T22:42:14.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b") failed: Property not found. retry in 1.281379603s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11472025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_d71379de-11dd-4f4f-9cf6-b8cd62627eef
11482025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_98a13b91-c9de-4224-9f66-1ba9750179be
11492025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156
11502025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_3158eaae-69db-489a-b04a-5e1d16ff999b
11512025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_603c176e-9d89-4099-ad42-bbbd6613b174
11522025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11532025-01-13T22:42:16.010ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11542025-01-13T22:42:16.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22750166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61495 req_id = 08db915a-a6cb-4a66-9446-a40f374bd495 response_code = 204 uri = /omicron-zones
11552025-01-13T22:42:16.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39567
11562025-01-13T22:42:16.072ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39567 req_id = 88d4add4-b33b-426a-b609-805f7292e542 response_code = 500 uri = /cockroachdb
11572025-01-13T22:42:16.072ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "88d4add4-b33b-426a-b609-805f7292e542", "content-length": "124", "date": "Mon, 13 Jan 2025 22:42:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "88d4add4-b33b-426a-b609-805f7292e542" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 131.552938ms
11582025-01-13T22:42:16.097ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48430
11592025-01-13T22:42:16.097ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48430 req_id = 06525443-68fd-48cf-a697-1046b187a916 response_code = 200 uri = /baseboard
11602025-01-13T22:42:16.230ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_21ccca49-da90-484a-8a83-c85f2ce5f156 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39567 req_id = afb9096f-6762-4377-8e64-1c088366ca5b response_code = 500 uri = /cockroachdb
11612025-01-13T22:42:16.230ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "afb9096f-6762-4377-8e64-1c088366ca5b", "content-length": "124", "date": "Mon, 13 Jan 2025 22:42:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "afb9096f-6762-4377-8e64-1c088366ca5b" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 79.808934ms
11622025-01-13T22:42:16.341ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3769
11632025-01-13T22:42:32.478ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
11642025-01-13T22:42:53.245ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
11652025-01-13T22:42:53.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36934793 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39567 req_id = e18bc9c6-63a1-4af5-b9a3-7d61f8ea6b57 response_code = 204 uri = /cockroachdb
11662025-01-13T22:42:53.248ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34842
11672025-01-13T22:42:53.250ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34842 req_id = 1a179787-7ef9-4411-a18f-671272f932b5 response_code = 200 uri = /baseboard
11682025-01-13T22:42:53.259ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.429355628s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
11692025-01-13T22:42:53.293ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: e682b62b-457a-4c56-8f10-146a56a0b849 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea1c6c62-6b91-4c2e-b341-59c749f0e249 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 703734af-afe4-469d-918d-477e69023a5c (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 (service), filesystem_pool: Some(ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 710e4c04-7e00-484c-bf02-f33f32105faf, kind: Service { id: 8db144c1-4533-4677-9edb-91f1abba0ad7 }, name: Name("ntp-8db144c1-4533-4677-9edb-91f1abba0ad7"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 84])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 98a13b91-c9de-4224-9f66-1ba9750179be (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } } } }, OmicronZoneConfig { id: 603c176e-9d89-4099-ad42-bbbd6613b174 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } } } }, OmicronZoneConfig { id: d71379de-11dd-4f4f-9cf6-b8cd62627eef (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } } } }, OmicronZoneConfig { id: 3158eaae-69db-489a-b04a-5e1d16ff999b (service), filesystem_pool: Some(ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 21ccca49-da90-484a-8a83-c85f2ce5f156 (service), filesystem_pool: Some(ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External } } } }, OmicronZoneConfig { id: c912cdb2-0bf8-4986-aea6-c21134511a15 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b (service), filesystem_pool: Some(ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f (service), filesystem_pool: Some(ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 (service), filesystem_pool: Some(ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 6a8a13ba-b82f-41ac-997c-fb535838d6a4 (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 3157368e-73f5-46c3-ac8b-e61d10c851be (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } } } }, OmicronZoneConfig { id: 81cef0b5-6b5a-4966-9a4a-47bc043517a1 (service), filesystem_pool: Some(ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 310e1802-0741-4ad6-a777-70e714ce66cb (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 652126ee-c2f6-4231-9e8e-da16608424b4 (service), filesystem_pool: Some(ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: c79e86c0-397d-4e4f-86c1-8ca2821a6327 (service), filesystem_pool: Some(ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External } } } }, OmicronZoneConfig { id: e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4 (service), filesystem_pool: Some(ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd (service), filesystem_pool: Some(ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External } } } }, OmicronZoneConfig { id: 6f5d1de3-18e6-4cb5-9b49-7f02be1d5188 (service), filesystem_pool: Some(ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External } } } }, OmicronZoneConfig { id: 84e46dce-4af6-47ff-867b-a14ae7eecdfd (service), filesystem_pool: Some(ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External } } } }, OmicronZoneConfig { id: 74c631dd-2e6c-4e06-8322-d5765e43cf1a (service), filesystem_pool: Some(ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External } } } }, OmicronZoneConfig { id: b89ca2ca-6cfa-4f17-86e5-6fd4a7517934 (service), filesystem_pool: Some(ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External } } } }, OmicronZoneConfig { id: 576ea471-1f6e-41b3-8ff9-7828868dca8e (service), filesystem_pool: Some(ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9139d358-d8ec-46c9-8365-f69c349c554d (service), filesystem_pool: Some(ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11702025-01-13T22:42:53.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53786
11712025-01-13T22:42:53.296ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11722025-01-13T22:42:53.296ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: InternalDns }, responder: ... }
11732025-01-13T22:42:53.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11742025-01-13T22:42:53.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11752025-01-13T22:42:53.320ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11762025-01-13T22:42:53.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: InternalDns }, responder: ... }
11772025-01-13T22:42:53.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11782025-01-13T22:42:53.330ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Cockroach }, responder: ... }
11792025-01-13T22:42:53.339ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11802025-01-13T22:42:53.339ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11812025-01-13T22:42:53.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11822025-01-13T22:42:53.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Cockroach }, responder: ... }
11832025-01-13T22:42:53.358ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11842025-01-13T22:42:53.358ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Cockroach }, responder: ... }
11852025-01-13T22:42:53.367ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11862025-01-13T22:42:53.367ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11872025-01-13T22:42:53.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11882025-01-13T22:42:53.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11892025-01-13T22:42:53.385ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11902025-01-13T22:42:53.385ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11912025-01-13T22:42:53.397ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11922025-01-13T22:42:53.397ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11932025-01-13T22:42:53.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11942025-01-13T22:42:53.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, kind: Crucible }, responder: ... }
11952025-01-13T22:42:53.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11962025-01-13T22:42:53.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, kind: Crucible }, responder: ... }
11972025-01-13T22:42:53.429ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11982025-01-13T22:42:53.429ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, kind: Crucible }, responder: ... }
11992025-01-13T22:42:53.440ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12002025-01-13T22:42:53.440ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, kind: Crucible }, responder: ... }
12012025-01-13T22:42:53.452ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12022025-01-13T22:42:53.452ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, kind: Crucible }, responder: ... }
12032025-01-13T22:42:53.463ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12042025-01-13T22:42:53.463ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, kind: Crucible }, responder: ... }
12052025-01-13T22:42:53.474ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12062025-01-13T22:42:53.474ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, kind: Crucible }, responder: ... }
12072025-01-13T22:42:53.483ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12082025-01-13T22:42:53.483ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, kind: Crucible }, responder: ... }
12092025-01-13T22:42:53.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12102025-01-13T22:42:53.495ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, kind: Crucible }, responder: ... }
12112025-01-13T22:42:53.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12122025-01-13T22:42:53.508ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
12132025-01-13T22:42:53.508ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
12142025-01-13T22:42:53.509ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12152025-01-13T22:42:53.696ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12162025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12172025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12192025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12202025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-01-13T22:42:53.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-01-13T22:42:53.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12242025-01-13T22:42:53.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12252025-01-13T22:42:53.910ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12262025-01-13T22:42:53.911ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12272025-01-13T22:42:53.924ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12282025-01-13T22:42:53.973ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12292025-01-13T22:42:53.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12302025-01-13T22:42:53.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12312025-01-13T22:42:53.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12322025-01-13T22:42:53.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12332025-01-13T22:42:53.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12342025-01-13T22:42:53.973ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = illumos-utils/src/zone.rs:325
12352025-01-13T22:42:53.978ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be file = illumos-utils/src/zone.rs:325
12362025-01-13T22:42:53.982ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb file = illumos-utils/src/zone.rs:325
12372025-01-13T22:42:53.988ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1 file = illumos-utils/src/zone.rs:325
12382025-01-13T22:42:53.993ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4 file = illumos-utils/src/zone.rs:325
12392025-01-13T22:42:53.998ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd file = illumos-utils/src/zone.rs:325
12402025-01-13T22:42:54.004ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188 file = illumos-utils/src/zone.rs:325
12412025-01-13T22:42:54.010ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327 file = illumos-utils/src/zone.rs:325
12422025-01-13T22:42:54.016ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d file = illumos-utils/src/zone.rs:325
12432025-01-13T22:42:54.117ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4 file = illumos-utils/src/zone.rs:363
12442025-01-13T22:42:54.122ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be file = illumos-utils/src/zone.rs:363
12452025-01-13T22:42:54.126ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb file = illumos-utils/src/zone.rs:363
12462025-01-13T22:42:54.130ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1 file = illumos-utils/src/zone.rs:363
12472025-01-13T22:42:54.135ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4 file = illumos-utils/src/zone.rs:363
12482025-01-13T22:42:54.140ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd file = illumos-utils/src/zone.rs:363
12492025-01-13T22:42:54.146ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188 file = illumos-utils/src/zone.rs:363
12502025-01-13T22:42:54.151ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327 file = illumos-utils/src/zone.rs:363
12512025-01-13T22:42:54.155ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d file = illumos-utils/src/zone.rs:363
12522025-01-13T22:42:54.160ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd file = illumos-utils/src/zone.rs:325
12532025-01-13T22:42:54.165ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a file = illumos-utils/src/zone.rs:325
12542025-01-13T22:42:54.171ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4 file = illumos-utils/src/zone.rs:325
12552025-01-13T22:42:54.177ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934 file = illumos-utils/src/zone.rs:325
12562025-01-13T22:42:54.182ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e file = illumos-utils/src/zone.rs:325
12572025-01-13T22:42:54.236ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12582025-01-13T22:42:54.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd file = illumos-utils/src/zone.rs:363
12592025-01-13T22:42:54.254ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a file = illumos-utils/src/zone.rs:363
12602025-01-13T22:42:54.265ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4 file = illumos-utils/src/zone.rs:363
12612025-01-13T22:42:54.279ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934 file = illumos-utils/src/zone.rs:363
12622025-01-13T22:42:54.299ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e file = illumos-utils/src/zone.rs:363
12632025-01-13T22:42:54.394ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12642025-01-13T22:42:54.452ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12652025-01-13T22:42:54.510ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12662025-01-13T22:42:54.568ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12672025-01-13T22:42:54.571ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12682025-01-13T22:42:54.571ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12692025-01-13T22:42:54.620ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 138, 83]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12702025-01-13T22:42:54.620ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12712025-01-13T22:42:54.633ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12722025-01-13T22:42:54.633ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12732025-01-13T22:42:54.744ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 156, 72]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12742025-01-13T22:42:54.744ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12752025-01-13T22:42:54.745ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12762025-01-13T22:42:54.745ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12772025-01-13T22:42:54.747ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12782025-01-13T22:42:54.747ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12792025-01-13T22:42:54.880ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 181, 67]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12802025-01-13T22:42:54.880ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12812025-01-13T22:42:54.882ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12822025-01-13T22:42:54.882ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12832025-01-13T22:42:54.945ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 230, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12842025-01-13T22:42:54.945ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12852025-01-13T22:42:54.970ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12862025-01-13T22:42:54.970ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12872025-01-13T22:42:55.005ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 236, 254]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12882025-01-13T22:42:55.005ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12892025-01-13T22:42:55.005ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12902025-01-13T22:42:55.007ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12912025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12922025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12932025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12942025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12952025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12962025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12972025-01-13T22:42:55.067ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12982025-01-13T22:42:55.070ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12992025-01-13T22:42:55.070ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13002025-01-13T22:42:55.076ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13012025-01-13T22:42:55.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13022025-01-13T22:42:55.089ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13032025-01-13T22:42:55.136ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 file = illumos-utils/src/zone.rs:325
13042025-01-13T22:42:55.229ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13052025-01-13T22:42:55.229ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13062025-01-13T22:42:55.229ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b file = illumos-utils/src/zone.rs:325
13072025-01-13T22:42:55.238ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 file = illumos-utils/src/zone.rs:363
13082025-01-13T22:42:55.247ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15 file = illumos-utils/src/zone.rs:325
13092025-01-13T22:42:55.255ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f file = illumos-utils/src/zone.rs:325
13102025-01-13T22:42:55.262ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13112025-01-13T22:42:55.265ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b file = illumos-utils/src/zone.rs:363
13122025-01-13T22:42:55.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13132025-01-13T22:42:55.298ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15 file = illumos-utils/src/zone.rs:363
13142025-01-13T22:42:55.304ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f file = illumos-utils/src/zone.rs:363
13152025-01-13T22:42:55.317ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff file = illumos-utils/src/zone.rs:325
13162025-01-13T22:42:55.354ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff file = illumos-utils/src/zone.rs:363
13172025-01-13T22:43:04.017ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13182025-01-13T22:43:04.034ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13192025-01-13T22:43:04.131ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fadfef0e-aa4d-459b-8566-f5b2357938ee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13202025-01-13T22:43:04.145ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fade11ae-f57a-4b39-b5da-7338fae013a0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13212025-01-13T22:43:04.150ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_68c5966c-8942-45eb-a621-8fc500b81f8f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1915ad04-7f81-48c3-a1b2-3aa9f15af5d8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222025-01-13T22:43:04.153ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='08fc5fc1-f08a-4704-beba-40e6c37194ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13232025-01-13T22:43:04.163ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='06cf357c-cf2e-4679-9922-2ba762f110d6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13242025-01-13T22:43:04.166ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9260d14e-3165-43af-a297-8b2685485aec/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ac5d8712-c8e0-43bb-92e0-d5b4d4866658'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13252025-01-13T22:43:04.166ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9354aa69-696c-440b-b6c7-ace42c12f2ac'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13262025-01-13T22:43:04.168ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13272025-01-13T22:43:04.185ZINFOSledAgent (ServiceManager): Booting oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13282025-01-13T22:43:04.198ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13292025-01-13T22:43:04.207ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13302025-01-13T22:43:04.216ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13312025-01-13T22:43:04.227ZINFOSledAgent (ServiceManager): Booting oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13322025-01-13T22:43:04.237ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13332025-01-13T22:43:04.444ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13342025-01-13T22:43:04.445ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13352025-01-13T22:43:04.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 72.324214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13362025-01-13T22:43:04.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 38.533745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13372025-01-13T22:43:04.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 68.21784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13382025-01-13T22:43:04.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 36.398873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13392025-01-13T22:43:04.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 74.083461ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13402025-01-13T22:43:04.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 74.620939ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13412025-01-13T22:43:04.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 68.96709ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13422025-01-13T22:43:04.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 114.954507ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13432025-01-13T22:43:04.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 114.827822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13442025-01-13T22:43:04.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 63.961213ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13452025-01-13T22:43:04.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 70.915647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13462025-01-13T22:43:04.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 103.316218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13472025-01-13T22:43:04.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 50.153563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13482025-01-13T22:43:04.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 127.537308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13492025-01-13T22:43:04.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 139.523761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13502025-01-13T22:43:04.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 86.132989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13512025-01-13T22:43:04.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 107.029147ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13522025-01-13T22:43:04.876ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='6a8a13ba-b82f-41ac-997c-fb535838d6a4'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13532025-01-13T22:43:04.877ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
13542025-01-13T22:43:04.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 119.311628ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13552025-01-13T22:43:04.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 123.358292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13562025-01-13T22:43:04.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 179.769721ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13572025-01-13T22:43:04.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 100.955231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13582025-01-13T22:43:04.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 124.522973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13592025-01-13T22:43:04.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 137.073002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13602025-01-13T22:43:04.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 119.304587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13612025-01-13T22:43:04.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 246.513781ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13622025-01-13T22:43:05.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 133.05694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13632025-01-13T22:43:05.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 122.602187ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13642025-01-13T22:43:05.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 219.561935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13652025-01-13T22:43:05.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 224.215265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13662025-01-13T22:43:05.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 558.582163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13672025-01-13T22:43:05.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 579.650265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13682025-01-13T22:43:05.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 323.0411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13692025-01-13T22:43:05.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 204.139857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13702025-01-13T22:43:05.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 63.491481ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
13712025-01-13T22:43:05.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 485.607076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13722025-01-13T22:43:05.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 276.523464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13732025-01-13T22:43:05.178ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13742025-01-13T22:43:05.179ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
13752025-01-13T22:43:05.187ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13762025-01-13T22:43:05.188ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
13772025-01-13T22:43:05.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 142.812216ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
13782025-01-13T22:43:05.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 313.090458ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13792025-01-13T22:43:05.257ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c6fac2d6-b970-42d0-b0a6-78707b83f044'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13802025-01-13T22:43:05.257ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13812025-01-13T22:43:05.257ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
13822025-01-13T22:43:05.264ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
13832025-01-13T22:43:05.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.05287104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
13842025-01-13T22:43:05.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.177933286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
13852025-01-13T22:43:05.298ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2251623a-88af-47cc-ad18-2d54f894c83c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13862025-01-13T22:43:05.298ZINFOSledAgent (ServiceManager): Booting oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
13872025-01-13T22:43:05.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 672.572544ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
13882025-01-13T22:43:05.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 285.918919ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
13892025-01-13T22:43:05.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 936.194569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
13902025-01-13T22:43:05.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.117737097s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
13912025-01-13T22:43:05.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 525.29453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
13922025-01-13T22:43:05.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.07619192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
13932025-01-13T22:43:05.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 579.892756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
13942025-01-13T22:43:05.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 51.235728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
13952025-01-13T22:43:05.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 627.858844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
13962025-01-13T22:43:05.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 25.6457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
13972025-01-13T22:43:05.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 136.951172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
13982025-01-13T22:43:05.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 124.877967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
13992025-01-13T22:43:05.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 52.632469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14002025-01-13T22:43:05.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 41.118231ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14012025-01-13T22:43:05.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 41.55338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14022025-01-13T22:43:05.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 110.818844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14032025-01-13T22:43:05.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 60.712865ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14042025-01-13T22:43:05.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 580.174717ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
14052025-01-13T22:43:05.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 131.071517ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14062025-01-13T22:43:05.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 121.060535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
14072025-01-13T22:43:06.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 98.793006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14082025-01-13T22:43:06.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 290.870576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14092025-01-13T22:43:06.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 134.380682ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14102025-01-13T22:43:06.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 293.733111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14112025-01-13T22:43:06.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 546.190883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
14122025-01-13T22:43:06.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 478.397355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
14132025-01-13T22:43:06.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.481601893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
14142025-01-13T22:43:06.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 128.02055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14152025-01-13T22:43:06.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 972.416386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
14162025-01-13T22:43:06.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 507.465266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
14172025-01-13T22:43:06.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 490.684493ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14182025-01-13T22:43:06.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 828.984292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
14192025-01-13T22:43:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.351604322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
14202025-01-13T22:43:06.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 224.825261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14212025-01-13T22:43:06.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 444.852493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14222025-01-13T22:43:06.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.188534552s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
14232025-01-13T22:43:06.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 671.668979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14242025-01-13T22:43:06.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.015397948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
14252025-01-13T22:43:06.618ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14262025-01-13T22:43:06.618ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14272025-01-13T22:43:06.618ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14282025-01-13T22:43:06.631ZINFOSledAgent (ServiceManager): Booting oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14292025-01-13T22:43:06.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.300583376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
14302025-01-13T22:43:06.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 419.805927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14312025-01-13T22:43:06.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.340092436s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
14322025-01-13T22:43:06.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 1.069729798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
14332025-01-13T22:43:06.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.426095705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
14342025-01-13T22:43:06.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.133659279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
14352025-01-13T22:43:06.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.037541469s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14362025-01-13T22:43:07.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 37.013806ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14372025-01-13T22:43:07.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 67.909706ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14382025-01-13T22:43:07.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 539.113999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14392025-01-13T22:43:07.037ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402025-01-13T22:43:07.039ZINFOSledAgent (ServiceManager): Booting oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14412025-01-13T22:43:07.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 108.356044ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14422025-01-13T22:43:07.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 116.503593ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14432025-01-13T22:43:07.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 278.318314ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14442025-01-13T22:43:07.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 1.142136786s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14452025-01-13T22:43:07.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 269.163225ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14462025-01-13T22:43:07.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 585.406982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14472025-01-13T22:43:07.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 882.891042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
14482025-01-13T22:43:07.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 34.080225ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14492025-01-13T22:43:07.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 862.061116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
14502025-01-13T22:43:07.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 115.298475ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14512025-01-13T22:43:07.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 268.940679ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14522025-01-13T22:43:07.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 491.019005ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14532025-01-13T22:43:07.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 263.702968ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14542025-01-13T22:43:07.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 548.079532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14552025-01-13T22:43:07.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.033807684s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
14562025-01-13T22:43:07.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 934.095887ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14572025-01-13T22:43:07.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 517.198592ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
14582025-01-13T22:43:07.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.352014003s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
14592025-01-13T22:43:07.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 276.393503ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14602025-01-13T22:43:07.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.433636977s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
14612025-01-13T22:43:07.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.179134448s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14622025-01-13T22:43:07.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 860.382852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
14632025-01-13T22:43:08.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.37494318s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14642025-01-13T22:43:08.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 574.729429ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14652025-01-13T22:43:08.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.243781695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
14662025-01-13T22:43:08.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.43695229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
14672025-01-13T22:43:08.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.172036878s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14682025-01-13T22:43:08.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 525.423295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14692025-01-13T22:43:08.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 913.119373ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
14702025-01-13T22:43:08.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 852.385899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
14712025-01-13T22:43:08.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 523.106339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
14722025-01-13T22:43:08.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.008037073s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
14732025-01-13T22:43:08.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 988.532646ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
14742025-01-13T22:43:08.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 1.189258356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14752025-01-13T22:43:08.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.040594224s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14762025-01-13T22:43:08.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.112007749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
14772025-01-13T22:43:08.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.240924763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14782025-01-13T22:43:08.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.155589326s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14792025-01-13T22:43:08.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 1.326135796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
14802025-01-13T22:43:08.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.002953902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
14812025-01-13T22:43:09.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.187056953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
14822025-01-13T22:43:09.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.071790194s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
14832025-01-13T22:43:09.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 1.43132712s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
14842025-01-13T22:43:09.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 611.305884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
14852025-01-13T22:43:09.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.476686428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
14862025-01-13T22:43:09.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.278760886s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
14872025-01-13T22:43:09.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 625.587889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
14882025-01-13T22:43:09.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.283521357s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
14892025-01-13T22:43:09.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.267750703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
14902025-01-13T22:43:09.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.081852831s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
14912025-01-13T22:43:09.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.043381301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
14922025-01-13T22:43:09.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 991.764888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
14932025-01-13T22:43:09.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.374863935s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
14942025-01-13T22:43:09.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 612.048957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
14952025-01-13T22:43:09.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 979.267903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
14962025-01-13T22:43:09.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.127899404s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
14972025-01-13T22:43:09.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.315887285s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
14982025-01-13T22:43:09.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 854.045108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
14992025-01-13T22:43:09.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 598.878033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
15002025-01-13T22:43:10.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 859.444438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15012025-01-13T22:43:10.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 875.560328ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15022025-01-13T22:43:10.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.025027337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15032025-01-13T22:43:10.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 691.101053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
15042025-01-13T22:43:10.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 999.542641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
15052025-01-13T22:43:10.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 1.173636881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
15062025-01-13T22:43:10.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.181583951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
15072025-01-13T22:43:10.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 1.135202162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
15082025-01-13T22:43:10.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.401510678s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
15092025-01-13T22:43:10.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.061717895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
15102025-01-13T22:43:10.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 575.419161ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15112025-01-13T22:43:10.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.319015357s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
15122025-01-13T22:43:10.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 958.670398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
15132025-01-13T22:43:10.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 682.924038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
15142025-01-13T22:43:10.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.21148636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
15152025-01-13T22:43:10.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 638.05139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
15162025-01-13T22:43:11.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 863.619417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15172025-01-13T22:43:11.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.044258753s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15182025-01-13T22:43:11.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.298794857s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
15192025-01-13T22:43:11.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.331678535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
15202025-01-13T22:43:11.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.008983737s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
15212025-01-13T22:43:11.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.070511039s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15222025-01-13T22:43:11.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.063750894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15232025-01-13T22:43:11.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.044867221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
15242025-01-13T22:43:11.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.179662164s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
15252025-01-13T22:43:11.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.176035324s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
15262025-01-13T22:43:11.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 891.879117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
15272025-01-13T22:43:11.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 1.402365796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
15282025-01-13T22:43:11.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 554.530569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
15292025-01-13T22:43:11.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.139311511s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
15302025-01-13T22:43:11.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 778.143042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
15312025-01-13T22:43:11.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 510.336921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15322025-01-13T22:43:11.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 559.312895ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
15332025-01-13T22:43:12.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.323149221s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
15342025-01-13T22:43:12.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 512.965116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
15352025-01-13T22:43:12.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 973.387028ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15362025-01-13T22:43:12.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.466370467s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
15372025-01-13T22:43:12.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 735.502583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15382025-01-13T22:43:12.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 978.065888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
15392025-01-13T22:43:12.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 618.874911ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
15402025-01-13T22:43:12.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 571.824719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15412025-01-13T22:43:12.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 1.49217111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15422025-01-13T22:43:12.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.221742851s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
15432025-01-13T22:43:12.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 756.644247ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
15442025-01-13T22:43:12.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.025214443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
15452025-01-13T22:43:12.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.401222642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
15462025-01-13T22:43:12.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 856.805269ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
15472025-01-13T22:43:12.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.071942903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
15482025-01-13T22:43:12.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.235521082s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
15492025-01-13T22:43:12.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 944.016735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
15502025-01-13T22:43:12.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.292398829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
15512025-01-13T22:43:13.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 853.393842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15522025-01-13T22:43:13.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 570.86376ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
15532025-01-13T22:43:13.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 568.035616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15542025-01-13T22:43:13.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 620.59005ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
15552025-01-13T22:43:13.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.042238971s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15562025-01-13T22:43:13.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 697.079533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
15572025-01-13T22:43:13.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 820.538516ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
15582025-01-13T22:43:13.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 636.523243ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
15592025-01-13T22:43:13.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 635.256973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
15602025-01-13T22:43:13.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 987.386493ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
15612025-01-13T22:43:13.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 785.808018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
15622025-01-13T22:43:13.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 864.073866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15632025-01-13T22:43:13.654ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15642025-01-13T22:43:13.654ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15652025-01-13T22:43:13.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 644.618876ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
15662025-01-13T22:43:13.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 751.849644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
15672025-01-13T22:43:13.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.116348691s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
15682025-01-13T22:43:13.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 918.691776ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
15692025-01-13T22:43:13.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.381527964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
15702025-01-13T22:43:13.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.097811878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15712025-01-13T22:43:13.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 51.323684ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15722025-01-13T22:43:13.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 1.187235781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15732025-01-13T22:43:13.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 67.42973ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15742025-01-13T22:43:14.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 512.548337ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
15752025-01-13T22:43:14.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 1.113227277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
15762025-01-13T22:43:14.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.289658376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
15772025-01-13T22:43:14.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 610.326034ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
15782025-01-13T22:43:14.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 177.63844ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15792025-01-13T22:43:14.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.31886061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
15802025-01-13T22:43:14.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.002737979s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
15812025-01-13T22:43:14.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.474447306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
15822025-01-13T22:43:14.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 629.62026ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15832025-01-13T22:43:14.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 319.580503ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15842025-01-13T22:43:14.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 586.254811ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
15852025-01-13T22:43:14.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.313268981s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
15862025-01-13T22:43:14.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.156211452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
15872025-01-13T22:43:14.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.096967598s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
15882025-01-13T22:43:14.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 554.535572ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15892025-01-13T22:43:14.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.364428879s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
15902025-01-13T22:43:14.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 777.780528ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
15912025-01-13T22:43:14.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 775.479989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
15922025-01-13T22:43:14.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 533.096049ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
15932025-01-13T22:43:14.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 934.529441ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
15942025-01-13T22:43:14.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.400225512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
15952025-01-13T22:43:14.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 848.900334ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
15962025-01-13T22:43:14.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 518.490097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
15972025-01-13T22:43:15.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.445491912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
15982025-01-13T22:43:15.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 718.677928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
15992025-01-13T22:43:15.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 597.025853ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
16002025-01-13T22:43:15.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 1.125908136s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
16012025-01-13T22:43:15.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 938.606244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
16022025-01-13T22:43:15.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 934.156274ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
16032025-01-13T22:43:15.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.492836098s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
16042025-01-13T22:43:15.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 1.292369201s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16052025-01-13T22:43:15.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 1.463304032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
16062025-01-13T22:43:15.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 696.731514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
16072025-01-13T22:43:15.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 555.224439ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
16082025-01-13T22:43:15.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.404000544s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
16092025-01-13T22:43:15.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 773.059205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
16102025-01-13T22:43:15.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.230095741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
16112025-01-13T22:43:15.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 610.132528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
16122025-01-13T22:43:15.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.218247089s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
16132025-01-13T22:43:15.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.169760664s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
16142025-01-13T22:43:15.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.446648383s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
16152025-01-13T22:43:15.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 618.864602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
16162025-01-13T22:43:16.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.474306301s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
16172025-01-13T22:43:16.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.211417491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
16182025-01-13T22:43:16.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 578.734824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
16192025-01-13T22:43:16.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 1.056222784s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
16202025-01-13T22:43:16.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.056467354s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
16212025-01-13T22:43:16.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e") failed: Property not found. retry in 1.344056108s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
16222025-01-13T22:43:16.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934") failed: Property not found. retry in 733.253395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
16232025-01-13T22:43:16.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 996.671964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
16242025-01-13T22:43:16.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.299822282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
16252025-01-13T22:43:16.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 1.192279355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
16262025-01-13T22:43:16.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 862.990869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
16272025-01-13T22:43:16.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 809.468089ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16282025-01-13T22:43:16.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 709.062491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
16292025-01-13T22:43:16.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.006072807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
16302025-01-13T22:43:16.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 990.032444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
16312025-01-13T22:43:16.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 1.293935599s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
16322025-01-13T22:43:17.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f") failed: Property not found. retry in 1.068708101s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
16332025-01-13T22:43:17.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 1.0066074s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
16342025-01-13T22:43:17.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 548.106387ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
16352025-01-13T22:43:17.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd") failed: Property not found. retry in 754.290991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
16362025-01-13T22:43:17.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 614.979201ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
16372025-01-13T22:43:17.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4") failed: Property not found. retry in 1.350626127s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
16382025-01-13T22:43:17.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb") failed: Property not found. retry in 1.388739208s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
16392025-01-13T22:43:17.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d") failed: Property not found. retry in 1.369779008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
16402025-01-13T22:43:17.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1") failed: Property not found. retry in 1.384889954s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
16412025-01-13T22:43:17.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b") failed: Property not found. retry in 1.297671595s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
16422025-01-13T22:43:17.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327") failed: Property not found. retry in 1.074526626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
16432025-01-13T22:43:17.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 666.297952ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16442025-01-13T22:43:17.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15") failed: Property not found. retry in 1.063413597s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
16452025-01-13T22:43:17.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 669.791355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
16462025-01-13T22:43:17.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 594.152242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
16472025-01-13T22:43:17.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff") failed: Property not found. retry in 1.153934367s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
16482025-01-13T22:43:17.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a") failed: Property not found. retry in 1.473155082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
16492025-01-13T22:43:17.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd") failed: Property not found. retry in 958.065381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
16502025-01-13T22:43:18.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7") failed: Property not found. retry in 934.877023ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
16512025-01-13T22:43:18.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 902.124974ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16522025-01-13T22:43:18.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188") failed: Property not found. retry in 664.589705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
16532025-01-13T22:43:18.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4") failed: Property not found. retry in 1.083251886s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
16542025-01-13T22:43:18.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4") failed: Property not found. retry in 660.857698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
16552025-01-13T22:43:19.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 741.410215ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16562025-01-13T22:43:19.317ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.840485199s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
16572025-01-13T22:43:19.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 1.297081518s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16582025-01-13T22:43:21.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be") failed: Property not found. retry in 1.428107508s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16592025-01-13T22:43:22.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_6a8a13ba-b82f-41ac-997c-fb535838d6a4
16602025-01-13T22:43:22.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_3157368e-73f5-46c3-ac8b-e61d10c851be
16612025-01-13T22:43:22.746ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_310e1802-0741-4ad6-a777-70e714ce66cb
16622025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_81cef0b5-6b5a-4966-9a4a-47bc043517a1
16632025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_e8e2dfbb-b2e5-4ea6-9cd3-d2484c2360c4
16642025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_84e46dce-4af6-47ff-867b-a14ae7eecdfd
16652025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6f5d1de3-18e6-4cb5-9b49-7f02be1d5188
16662025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_fd7f4520-725e-4f16-b5c4-7e0ce46dabe7
16672025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_c79e86c0-397d-4e4f-86c1-8ca2821a6327
16682025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_9139d358-d8ec-46c9-8365-f69c349c554d
16692025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_c912cdb2-0bf8-4986-aea6-c21134511a15
16702025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_e2ea1649-0cbb-4e8e-94f3-d1c42484c55f
16712025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_e4c35da2-31ab-4a52-ae76-9faa2bfde5ff
16722025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_2cd343d4-bbba-4bcc-a1b1-104b9b3eeccd
16732025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_74c631dd-2e6c-4e06-8322-d5765e43cf1a
16742025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_652126ee-c2f6-4231-9e8e-da16608424b4
16752025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_b89ca2ca-6cfa-4f17-86e5-6fd4a7517934
16762025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_576ea471-1f6e-41b3-8ff9-7828868dca8e
16772025-01-13T22:43:22.747ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_36b2613b-f9d1-4d6f-8228-e3a5f78bec0b
16782025-01-13T22:43:22.749ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16792025-01-13T22:43:22.755ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16802025-01-13T22:43:22.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29464624 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53786 req_id = eecfba66-bd3b-4464-9d74-3d24a1932415 response_code = 204 uri = /omicron-zones
16812025-01-13T22:43:22.775ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16822025-01-13T22:43:22.786ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16832025-01-13T22:43:22.791ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
16842025-01-13T22:43:22.829ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
16852025-01-13T22:43:22.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16862025-01-13T22:43:22.968ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16872025-01-13T22:43:23.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16882025-01-13T22:43:23.158ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16892025-01-13T22:43:23.306ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34356
16902025-01-13T22:43:23.309ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2462 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34356 req_id = 5c52be2f-cf49-4f0e-a699-5b7b74f5202d response_code = 200 uri = /baseboard
16912025-01-13T22:43:23.417ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16922025-01-13T22:43:23.594ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16932025-01-13T22:43:23.844ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16942025-01-13T22:43:24.013ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16952025-01-13T22:43:24.527ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16962025-01-13T22:43:24.950ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16972025-01-13T22:43:25.554ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16982025-01-13T22:43:26.445ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/646472ad-69b3-4142-8cd4-bbfc619624e6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16992025-01-13T22:43:27.199ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.846361344s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
17002025-01-13T22:43:27.773ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e5172c4d-af71-4066-98de-02766795c26a", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"646472ad-69b3-4142-8cd4-bbfc619624e6\"", request_id: "e5172c4d-af71-4066-98de-02766795c26a" } file = sled-agent/src/rack_setup/service.rs:1079
17012025-01-13T22:43:28.956ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "129962d0-e4ce-4e34-93cf-bc817287e472", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"646472ad-69b3-4142-8cd4-bbfc619624e6\"", request_id: "129962d0-e4ce-4e34-93cf-bc817287e472" } file = sled-agent/src/rack_setup/service.rs:1079
17022025-01-13T22:43:30.097ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c5ee6781-4060-463e-9de0-b91056b910a9", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"646472ad-69b3-4142-8cd4-bbfc619624e6\"", request_id: "c5ee6781-4060-463e-9de0-b91056b910a9" } file = sled-agent/src/rack_setup/service.rs:1079
17032025-01-13T22:43:34.186ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "625b9df0-f44b-45bd-b8a5-83a779641fce", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:34 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "625b9df0-f44b-45bd-b8a5-83a779641fce" } file = sled-agent/src/rack_setup/service.rs:1079
17042025-01-13T22:43:36.435ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fb5b9518-c8d3-4e6f-808f-d5287bd24d51", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "fb5b9518-c8d3-4e6f-808f-d5287bd24d51" } file = sled-agent/src/rack_setup/service.rs:1079
17052025-01-13T22:43:38.879ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3bb614dd-7985-4483-b991-caeb9d0cd5f0", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "3bb614dd-7985-4483-b991-caeb9d0cd5f0" } file = sled-agent/src/rack_setup/service.rs:1079
17062025-01-13T22:43:42.984ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "38a61973-e828-47ad-9485-33ef8cab5e19", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "38a61973-e828-47ad-9485-33ef8cab5e19" } file = sled-agent/src/rack_setup/service.rs:1079
17072025-01-13T22:43:47.530ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2585d12b-c67c-4a0b-8036-1b16a674a1ea", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "2585d12b-c67c-4a0b-8036-1b16a674a1ea" } file = sled-agent/src/rack_setup/service.rs:1079
17082025-01-13T22:43:51.623ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5199bbac-d248-4e4f-941a-d78f249a26da", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "5199bbac-d248-4e4f-941a-d78f249a26da" } file = sled-agent/src/rack_setup/service.rs:1079
17092025-01-13T22:43:53.347ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34825
17102025-01-13T22:43:53.348ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34825 req_id = 6981e049-6bd5-4e2c-8997-5e675ee6866c response_code = 200 uri = /baseboard
17112025-01-13T22:43:54.492ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3d2ce5af-c176-4f90-9324-3a952ac452a0", "content-length": "173", "date": "Mon, 13 Jan 2025 22:43:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "3d2ce5af-c176-4f90-9324-3a952ac452a0" } file = sled-agent/src/rack_setup/service.rs:1079
17122025-01-13T22:44:01.113ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b13af751-b6ed-47fe-bd95-592b02c0bb82", "content-length": "173", "date": "Mon, 13 Jan 2025 22:44:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "b13af751-b6ed-47fe-bd95-592b02c0bb82" } file = sled-agent/src/rack_setup/service.rs:1079
17132025-01-13T22:44:07.409ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0db381e0-8b21-47f6-951d-9e5f983cb676", "content-length": "173", "date": "Mon, 13 Jan 2025 22:44:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"bd8d50a3-f530-430e-8ded-11b6657cae3b\"", request_id: "0db381e0-8b21-47f6-951d-9e5f983cb676" } file = sled-agent/src/rack_setup/service.rs:1079
17142025-01-13T22:44:11.760ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
17152025-01-13T22:44:11.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45603
17162025-01-13T22:44:11.871ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17172025-01-13T22:44:11.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17182025-01-13T22:44:11.872ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
17192025-01-13T22:44:11.873ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
17202025-01-13T22:44:11.888ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17212025-01-13T22:44:11.888ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e
17222025-01-13T22:44:11.913ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17232025-01-13T22:44:11.913ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612
17242025-01-13T22:44:11.934ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17252025-01-13T22:44:11.934ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a
17262025-01-13T22:44:11.956ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17272025-01-13T22:44:11.956ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68c5966c-8942-45eb-a621-8fc500b81f8f
17282025-01-13T22:44:11.976ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17292025-01-13T22:44:11.976ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250
17302025-01-13T22:44:11.995ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17312025-01-13T22:44:11.995ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9260d14e-3165-43af-a297-8b2685485aec
17322025-01-13T22:44:12.015ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17332025-01-13T22:44:12.015ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477
17342025-01-13T22:44:12.036ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17352025-01-13T22:44:12.036ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447
17362025-01-13T22:44:12.057ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17372025-01-13T22:44:12.057ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab
17382025-01-13T22:44:12.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45603 req_id = 24352570-5d79-4295-afa4-6bbed77b961c response_code = 200 uri = /inventory
17392025-01-13T22:44:14.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42249
17402025-01-13T22:44:14.841ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17412025-01-13T22:44:14.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17422025-01-13T22:44:14.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17432025-01-13T22:44:14.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17442025-01-13T22:44:14.841ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17452025-01-13T22:44:14.842ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17462025-01-13T22:44:14.842ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472025-01-13T22:44:14.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42249 req_id = f0ef0773-74ac-4670-b707-d8b2ceab6a08 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17482025-01-13T22:44:14.844ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17492025-01-13T22:44:14.848ZINFOSledAgent (RSS): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17502025-01-13T22:44:14.848ZINFOSledAgent (RSS): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17512025-01-13T22:44:14.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65469
17522025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17532025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17542025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17552025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17562025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17572025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17582025-01-13T22:44:14.898ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17592025-01-13T22:44:14.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65469 req_id = 96795960-83fa-4797-b694-d768e9fc476b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17602025-01-13T22:44:15.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60909
17612025-01-13T22:44:15.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17622025-01-13T22:44:15.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17632025-01-13T22:44:15.119ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
17642025-01-13T22:44:15.119ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
17652025-01-13T22:44:15.131ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662025-01-13T22:44:15.131ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e
17672025-01-13T22:44:15.154ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17682025-01-13T22:44:15.154ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612
17692025-01-13T22:44:15.177ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17702025-01-13T22:44:15.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a
17712025-01-13T22:44:15.199ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17722025-01-13T22:44:15.199ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68c5966c-8942-45eb-a621-8fc500b81f8f
17732025-01-13T22:44:15.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17742025-01-13T22:44:15.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250
17752025-01-13T22:44:15.240ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17762025-01-13T22:44:15.240ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9260d14e-3165-43af-a297-8b2685485aec
17772025-01-13T22:44:15.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17782025-01-13T22:44:15.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477
17792025-01-13T22:44:15.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17802025-01-13T22:44:15.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447
17812025-01-13T22:44:15.302ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17822025-01-13T22:44:15.302ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab
17832025-01-13T22:44:15.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60909 req_id = f449fba1-346b-4576-9b75-b8237f43b8e1 response_code = 200 uri = /inventory
17842025-01-13T22:44:15.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41637
17852025-01-13T22:44:15.688ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17862025-01-13T22:44:15.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17872025-01-13T22:44:15.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17882025-01-13T22:44:15.689ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17892025-01-13T22:44:15.689ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17902025-01-13T22:44:15.689ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17912025-01-13T22:44:15.689ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922025-01-13T22:44:15.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41637 req_id = 556a81df-f5f5-43bf-918e-890f49087d07 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17932025-01-13T22:44:16.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61064
17942025-01-13T22:44:16.234ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17952025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17962025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17972025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17982025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17992025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18002025-01-13T22:44:16.235ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012025-01-13T22:44:16.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61064 req_id = 841d69fd-87eb-4494-bc55-7fabcb97c803 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18022025-01-13T22:44:22.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38558
18032025-01-13T22:44:22.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38558 req_id = 3546d1bb-dc94-4a81-8078-c21e8e201c68 response_code = 200 uri = /vpc-routes
18042025-01-13T22:44:22.819ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18052025-01-13T22:44:22.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38558 req_id = df18e57d-f58d-4db1-b21f-520fd37dce13 response_code = 204 uri = /eip-gateways
18062025-01-13T22:44:22.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7835 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38558 req_id = e8d172e0-172f-4d0b-9de0-d15d9a2b2b47 response_code = 204 uri = /vpc-routes
18072025-01-13T22:44:23.385ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35061
18082025-01-13T22:44:23.385ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35061 req_id = 7acc088c-0064-4781-860f-13fc9d87feb1 response_code = 200 uri = /baseboard
18092025-01-13T22:44:28.522ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:42873 remote_addr = [fd00:1122:3344:101::d]:46486 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
18102025-01-13T22:44:28.561ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37984 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 53c6e0e0-2581-431d-9fb4-cc1219f81ede response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
18112025-01-13T22:44:30.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38705
18122025-01-13T22:44:30.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38705 req_id = 1faa30c8-0c0b-49b8-8b67-0f846ebd8648 response_code = 200 uri = /vpc-routes
18132025-01-13T22:44:30.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39156
18142025-01-13T22:44:30.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39156 req_id = 2244d20a-60ef-406b-a9f4-c9839610b652 response_code = 200 uri = /v2p
18152025-01-13T22:44:31.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18162025-01-13T22:44:31.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38705 req_id = 9a1d4095-05a5-494b-ac25-ed42fef68da8 response_code = 204 uri = /eip-gateways
18172025-01-13T22:44:31.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38705 req_id = 34a9de8b-0c02-4910-84b8-c7d0d7c3c603 response_code = 204 uri = /vpc-routes
18182025-01-13T22:44:31.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36064
18192025-01-13T22:44:31.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36064 req_id = 10a7671c-e361-4096-aa95-7ac30ba6d783 response_code = 200 uri = /v2p
18202025-01-13T22:44:31.336ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55325
18212025-01-13T22:44:31.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55325 req_id = 49171aba-f1be-4c91-82c5-42559d3f3ab7 response_code = 200 uri = /vpc-routes
18222025-01-13T22:44:31.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63903
18232025-01-13T22:44:31.376ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18242025-01-13T22:44:31.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18252025-01-13T22:44:31.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63903 req_id = 45add30f-12bd-4b2e-a5ae-9fef3250dd4c response_code = 204 uri = /switch-ports
18262025-01-13T22:44:31.523ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18272025-01-13T22:44:31.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55325 req_id = ca6fd457-ede5-4d69-b6fd-f6d505077559 response_code = 204 uri = /eip-gateways
18282025-01-13T22:44:31.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2866 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63903 req_id = 87aa6575-0171-4d4c-8e42-4487ad064113 response_code = 200 uri = /network-bootstore-config
18292025-01-13T22:44:31.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55325 req_id = a6addd3b-e5ba-445b-8d5f-2633596bd4ca response_code = 204 uri = /vpc-routes
18302025-01-13T22:44:31.664ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18312025-01-13T22:44:31.665ZINFOSledAgent (bootstore): Writing ledger to /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18322025-01-13T22:44:31.666ZINFOSledAgent (bootstore): Writing ledger to /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18332025-01-13T22:44:31.667ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18342025-01-13T22:44:31.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4847 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63903 req_id = 0981ec85-d7f4-4012-b8f1-a2e47d49dff9 response_code = 204 uri = /network-bootstore-config
18352025-01-13T22:44:31.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41409
18362025-01-13T22:44:31.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18372025-01-13T22:44:31.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18382025-01-13T22:44:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41409 req_id = 46186121-9593-4bcc-b17c-8f0c5351b7cc response_code = 204 uri = /switch-ports
18392025-01-13T22:44:31.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41409 req_id = 85f72374-8a10-4626-9b0d-97736a7ff67f response_code = 200 uri = /network-bootstore-config
18402025-01-13T22:44:37.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61802
18412025-01-13T22:44:37.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61802 req_id = 064f60a9-4445-4cd1-b58f-cee22dd478f0 response_code = 200 uri = /vpc-routes
18422025-01-13T22:44:37.495ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18432025-01-13T22:44:37.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61802 req_id = a2bb6f5f-6134-4c26-aad1-e8ceb89bd43b response_code = 204 uri = /eip-gateways
18442025-01-13T22:44:37.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61802 req_id = e1b91c3a-c3a7-4449-8e51-d2bec18c8f09 response_code = 204 uri = /vpc-routes
18452025-01-13T22:44:37.705ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38532
18462025-01-13T22:44:37.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38532 req_id = fbd85a04-ff17-4cf5-b383-e017aa91f9d6 response_code = 200 uri = /v2p
18472025-01-13T22:44:37.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49178
18482025-01-13T22:44:37.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18492025-01-13T22:44:37.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18502025-01-13T22:44:37.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93890 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49178 req_id = 78b9e8de-89c2-45f8-935b-f7722571eb6c response_code = 204 uri = /switch-ports
18512025-01-13T22:44:37.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49178 req_id = ee600737-3ea3-4045-b1ed-c096fd2c81cd response_code = 200 uri = /network-bootstore-config
18522025-01-13T22:44:53.418ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47188
18532025-01-13T22:44:53.418ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47188 req_id = 0c9a7876-8f19-40c5-bd58-0ed9a16fb4a6 response_code = 200 uri = /baseboard
18542025-01-13T22:44:58.527ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6153 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = c88c3f49-b29e-4c27-86cf-4a3da36c6684 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
18552025-01-13T22:45:00.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48579
18562025-01-13T22:45:00.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48579 req_id = 2aad55cb-1359-4dbf-9540-e376c821e1c2 response_code = 200 uri = /vpc-routes
18572025-01-13T22:45:00.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18582025-01-13T22:45:00.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48579 req_id = 503ca768-fadd-441e-9f78-b80ac9189241 response_code = 204 uri = /eip-gateways
18592025-01-13T22:45:00.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48579 req_id = 1758fd4e-ac11-4f17-b73f-027c53f282cf response_code = 204 uri = /vpc-routes
18602025-01-13T22:45:00.912ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36919
18612025-01-13T22:45:00.912ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18622025-01-13T22:45:00.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18632025-01-13T22:45:01.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36919 req_id = a3a5fa3f-f311-443f-8ef1-45db2183cd6d response_code = 204 uri = /switch-ports
18642025-01-13T22:45:01.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64021
18652025-01-13T22:45:01.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36919 req_id = d9b2606f-7549-4c23-8c92-78ee5877f9b6 response_code = 200 uri = /network-bootstore-config
18662025-01-13T22:45:01.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64021 req_id = 3c9a1281-4bdc-405e-8901-2036fa1fde1e response_code = 200 uri = /v2p
18672025-01-13T22:45:01.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39213
18682025-01-13T22:45:01.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39213 req_id = bcda3358-d0e8-4c96-ad6c-9aaf3fdfcb94 response_code = 200 uri = /vpc-routes
18692025-01-13T22:45:01.358ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18702025-01-13T22:45:01.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39213 req_id = 9445f4e1-e204-4bd8-b782-c81703283517 response_code = 204 uri = /eip-gateways
18712025-01-13T22:45:01.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39213 req_id = feabb998-73f5-4e85-b21f-af2c890153dd response_code = 204 uri = /vpc-routes
18722025-01-13T22:45:01.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54684
18732025-01-13T22:45:01.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54684 req_id = b9f2063e-8eb1-4332-8203-bf19ff7f1ec8 response_code = 200 uri = /v2p
18742025-01-13T22:45:01.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51017
18752025-01-13T22:45:01.493ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18762025-01-13T22:45:01.577ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18772025-01-13T22:45:01.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51017 req_id = 075d2620-f4dd-47dd-a0ca-836caaeeed38 response_code = 204 uri = /switch-ports
18782025-01-13T22:45:01.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51017 req_id = eca6535e-abc3-4acf-8327-ae94d1001893 response_code = 200 uri = /network-bootstore-config
18792025-01-13T22:45:07.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47373
18802025-01-13T22:45:07.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47373 req_id = c4c904c2-ef42-4c51-8e88-0306b28e97e7 response_code = 200 uri = /vpc-routes
18812025-01-13T22:45:07.420ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18822025-01-13T22:45:07.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47373 req_id = 8c055cee-f031-4d17-8218-d0e29d71317e response_code = 204 uri = /eip-gateways
18832025-01-13T22:45:07.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47373 req_id = 61e52f8e-d919-4258-8f56-67fcf45f3a65 response_code = 204 uri = /vpc-routes
18842025-01-13T22:45:07.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55354
18852025-01-13T22:45:07.577ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18862025-01-13T22:45:07.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18872025-01-13T22:45:07.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55354 req_id = a4a2c33d-82a7-411f-a03e-a3582ab02397 response_code = 204 uri = /switch-ports
18882025-01-13T22:45:07.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57860
18892025-01-13T22:45:07.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57860 req_id = 503b1cd2-2a72-41b5-861d-eeffcaccd28b response_code = 200 uri = /v2p
18902025-01-13T22:45:07.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55354 req_id = b5ceacba-2e81-4ac7-b80d-9e470e74fe91 response_code = 200 uri = /network-bootstore-config
18912025-01-13T22:45:23.454ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34494
18922025-01-13T22:45:23.454ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34494 req_id = cdedbdd5-d86b-47cb-8239-2af29e6975d5 response_code = 200 uri = /baseboard
18932025-01-13T22:45:28.528ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6966 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 000bce02-f3d9-44a1-90ec-9a230a700671 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
18942025-01-13T22:45:30.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61380
18952025-01-13T22:45:30.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61380 req_id = 6caf3e62-e68e-48c3-ba5a-bfd830f28761 response_code = 200 uri = /v2p
18962025-01-13T22:45:31.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43224
18972025-01-13T22:45:31.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43224 req_id = f9a79c38-c007-4112-8dca-e7dccdc2785c response_code = 200 uri = /vpc-routes
18982025-01-13T22:45:31.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
18992025-01-13T22:45:31.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43224 req_id = 6d6bc1f1-049e-4092-a4b8-3191ca9f3074 response_code = 204 uri = /eip-gateways
19002025-01-13T22:45:31.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43224 req_id = 8ff0d304-a4a4-4605-afac-52f330037a8f response_code = 204 uri = /vpc-routes
19012025-01-13T22:45:31.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58643
19022025-01-13T22:45:31.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19032025-01-13T22:45:31.237ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19042025-01-13T22:45:31.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58643 req_id = a86caf01-0efe-4cae-b49b-7227779fb3ce response_code = 204 uri = /switch-ports
19052025-01-13T22:45:31.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58643 req_id = 25e6bfa1-cd35-4281-9d54-19a0cf6d0f7e response_code = 200 uri = /network-bootstore-config
19062025-01-13T22:45:31.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49575
19072025-01-13T22:45:31.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49575 req_id = fd42e994-bff3-4139-9ecf-2957326b1b54 response_code = 200 uri = /vpc-routes
19082025-01-13T22:45:31.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19092025-01-13T22:45:31.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49575 req_id = 5ebd27f2-1edc-4588-9eff-ddc3e1ba6b92 response_code = 204 uri = /eip-gateways
19102025-01-13T22:45:31.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41752
19112025-01-13T22:45:31.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41752 req_id = 8e6c4f87-aba6-46a5-afa6-e117f959826b response_code = 200 uri = /v2p
19122025-01-13T22:45:31.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49575 req_id = a4e1ce55-6fa8-4b93-bf4a-b416b0ac49c9 response_code = 204 uri = /vpc-routes
19132025-01-13T22:45:31.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61776
19142025-01-13T22:45:31.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19152025-01-13T22:45:31.764ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19162025-01-13T22:45:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61776 req_id = f70cca11-4e36-40f0-89c5-66715ae77aed response_code = 204 uri = /switch-ports
19172025-01-13T22:45:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61776 req_id = 0e5c5e06-c424-436d-8fa8-55ca5362bfaa response_code = 200 uri = /network-bootstore-config
19182025-01-13T22:45:37.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33499
19192025-01-13T22:45:37.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33499 req_id = 61b7dcc4-96ef-4d2b-bba5-9cd7b6978b85 response_code = 200 uri = /vpc-routes
19202025-01-13T22:45:37.599ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19212025-01-13T22:45:37.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33499 req_id = 37d27016-0ffa-4e1a-a930-b2e26fd5211b response_code = 204 uri = /eip-gateways
19222025-01-13T22:45:37.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50313
19232025-01-13T22:45:37.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50313 req_id = 8caaa251-e76f-4e29-ba51-830af4b2e90d response_code = 200 uri = /v2p
19242025-01-13T22:45:37.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33499 req_id = 4e75bd27-9198-4701-9d40-eec06960cb3e response_code = 204 uri = /vpc-routes
19252025-01-13T22:45:37.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58547
19262025-01-13T22:45:37.815ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19272025-01-13T22:45:37.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19282025-01-13T22:45:37.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58547 req_id = 63acc8a7-5b6c-4025-ad1c-74fcbd432297 response_code = 204 uri = /switch-ports
19292025-01-13T22:45:37.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58547 req_id = 982a9a26-573d-4947-acee-335744e5cf44 response_code = 200 uri = /network-bootstore-config
19302025-01-13T22:45:39.878ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19312025-01-13T22:45:53.486ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35416
19322025-01-13T22:45:53.486ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35416 req_id = 00dfb29e-f13d-4ef8-9214-eb071d06cbd5 response_code = 200 uri = /baseboard
19332025-01-13T22:45:58.528ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7515 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = db799320-a973-4641-a76f-3ef6ad88fbdf response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
19342025-01-13T22:46:00.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42372
19352025-01-13T22:46:00.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42372 req_id = 2bd5c8b4-f07e-4745-90d7-099ff3057ac0 response_code = 200 uri = /vpc-routes
19362025-01-13T22:46:00.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58936
19372025-01-13T22:46:00.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58936 req_id = c8377937-3225-44c8-b861-2d8b3e6e67bc response_code = 200 uri = /v2p
19382025-01-13T22:46:00.934ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19392025-01-13T22:46:00.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42372 req_id = b2b65c37-ba94-4536-82b4-86386f2516bb response_code = 204 uri = /eip-gateways
19402025-01-13T22:46:00.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42372 req_id = 98230e35-1b59-41a0-bca9-c90c61bf66f8 response_code = 204 uri = /vpc-routes
19412025-01-13T22:46:01.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50804
19422025-01-13T22:46:01.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19432025-01-13T22:46:01.042ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19442025-01-13T22:46:01.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50804 req_id = 4498dfee-3120-481a-9651-3c62761c7cb1 response_code = 204 uri = /switch-ports
19452025-01-13T22:46:01.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50804 req_id = 0638c0f3-5a59-4755-88d3-37ba96892360 response_code = 200 uri = /network-bootstore-config
19462025-01-13T22:46:01.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60836
19472025-01-13T22:46:01.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60836 req_id = e53868d5-ca55-433c-a999-1a2359d37dc7 response_code = 200 uri = /vpc-routes
19482025-01-13T22:46:01.255ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19492025-01-13T22:46:01.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60836 req_id = efcf99a5-8651-4476-86eb-1b02e25c5d87 response_code = 204 uri = /eip-gateways
19502025-01-13T22:46:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60836 req_id = 643f6492-94c0-4893-83fc-f620dd0ef2a4 response_code = 204 uri = /vpc-routes
19512025-01-13T22:46:01.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62005
19522025-01-13T22:46:01.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62005 req_id = 172d63d9-2cae-4b8b-a954-a7f9962f554d response_code = 200 uri = /v2p
19532025-01-13T22:46:01.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36938
19542025-01-13T22:46:01.461ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19552025-01-13T22:46:01.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19562025-01-13T22:46:01.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86907 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36938 req_id = 3d2843e0-b917-466b-bae4-619722e62a55 response_code = 204 uri = /switch-ports
19572025-01-13T22:46:01.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36938 req_id = f061c728-f566-4ac9-923c-073b9fca2553 response_code = 200 uri = /network-bootstore-config
19582025-01-13T22:46:07.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46505
19592025-01-13T22:46:07.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46505 req_id = 0dcf8d7d-ccc1-4904-a3a7-5de47630d491 response_code = 200 uri = /vpc-routes
19602025-01-13T22:46:07.467ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19612025-01-13T22:46:07.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46505 req_id = 12f41c0b-6b08-4346-8dc5-13a6804ece0c response_code = 204 uri = /eip-gateways
19622025-01-13T22:46:07.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46505 req_id = aea4805a-2e56-4b88-9433-39d00ff7a9be response_code = 204 uri = /vpc-routes
19632025-01-13T22:46:07.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37093
19642025-01-13T22:46:07.491ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19652025-01-13T22:46:07.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19662025-01-13T22:46:07.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92470 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37093 req_id = 2fdf9f0c-536d-42b7-823d-b55b4ebaff5b response_code = 204 uri = /switch-ports
19672025-01-13T22:46:07.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38660
19682025-01-13T22:46:07.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37093 req_id = afa4bd14-0077-4d29-a282-fcae1183a4bf response_code = 200 uri = /network-bootstore-config
19692025-01-13T22:46:07.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38660 req_id = e0ec0e0c-7605-4f22-ae1e-e981ad6b1bfc response_code = 200 uri = /v2p
19702025-01-13T22:46:23.519ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37579
19712025-01-13T22:46:23.520ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37579 req_id = 314f4ff7-8ea6-4bb2-aed0-8c359afdbc89 response_code = 200 uri = /baseboard
19722025-01-13T22:46:28.527ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6687 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 2f99a96e-8a05-47f9-b2cd-fc17b1b73c5d response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
19732025-01-13T22:46:30.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60192
19742025-01-13T22:46:30.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60192 req_id = 0debd9ad-5996-4ecf-bd1e-1d73e4c1c884 response_code = 200 uri = /vpc-routes
19752025-01-13T22:46:31.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42396
19762025-01-13T22:46:31.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42396 req_id = 8fe3dd7e-987c-4c17-b085-3109b71e63c2 response_code = 200 uri = /v2p
19772025-01-13T22:46:31.210ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19782025-01-13T22:46:31.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60192 req_id = 1aef738c-8aa9-48e7-8900-edd0ecb558cf response_code = 204 uri = /eip-gateways
19792025-01-13T22:46:31.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60192 req_id = bc2e1695-a3fc-4046-93a7-fe159e446828 response_code = 204 uri = /vpc-routes
19802025-01-13T22:46:31.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54865
19812025-01-13T22:46:31.325ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19822025-01-13T22:46:31.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19832025-01-13T22:46:31.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88348 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54865 req_id = 298cbc87-b17b-4546-a3e4-40ac660ff163 response_code = 204 uri = /switch-ports
19842025-01-13T22:46:31.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54865 req_id = 2d70c9c8-3a72-4609-a23f-d89d5c4f4721 response_code = 200 uri = /network-bootstore-config
19852025-01-13T22:46:31.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47003
19862025-01-13T22:46:31.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47003 req_id = c89137f7-b245-4989-9824-bad419217271 response_code = 200 uri = /vpc-routes
19872025-01-13T22:46:31.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38951
19882025-01-13T22:46:31.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38951 req_id = b5ceb6a3-3720-46d8-892c-ee3ed403ec26 response_code = 200 uri = /v2p
19892025-01-13T22:46:31.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
19902025-01-13T22:46:31.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47003 req_id = 53174c8d-ac62-437d-84ec-6d5db3ccc7cb response_code = 204 uri = /eip-gateways
19912025-01-13T22:46:31.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47003 req_id = cd65a32d-93ff-4be2-927c-0d7a5992b34e response_code = 204 uri = /vpc-routes
19922025-01-13T22:46:31.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57524
19932025-01-13T22:46:31.595ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19942025-01-13T22:46:31.632ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19952025-01-13T22:46:31.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57524 req_id = d85e7f37-ff57-478d-a7d9-f8bc265479ba response_code = 204 uri = /switch-ports
19962025-01-13T22:46:31.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57524 req_id = 8a185808-a719-42d1-9215-6072f60d7fea response_code = 200 uri = /network-bootstore-config
19972025-01-13T22:46:37.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33410
19982025-01-13T22:46:37.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33410 req_id = fa7aca3c-3887-4018-bb99-f07c36dab9f1 response_code = 200 uri = /vpc-routes
19992025-01-13T22:46:37.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43086
20002025-01-13T22:46:37.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43086 req_id = b620c046-dc55-4567-bd0e-89c616d0680f response_code = 200 uri = /v2p
20012025-01-13T22:46:37.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20022025-01-13T22:46:37.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33410 req_id = 530d6c3e-24d8-472e-91cd-405d16d77e4c response_code = 204 uri = /eip-gateways
20032025-01-13T22:46:37.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33410 req_id = 4e49b4f0-f508-425e-896b-662364fa3356 response_code = 204 uri = /vpc-routes
20042025-01-13T22:46:37.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65151
20052025-01-13T22:46:37.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20062025-01-13T22:46:37.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20072025-01-13T22:46:37.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65151 req_id = cf2254dd-42c1-4522-a6f7-863dceb47687 response_code = 204 uri = /switch-ports
20082025-01-13T22:46:37.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65151 req_id = 74cc040f-bd9b-423f-bfa1-b7c492e868e1 response_code = 200 uri = /network-bootstore-config
20092025-01-13T22:46:53.551ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47352
20102025-01-13T22:46:53.552ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47352 req_id = 564e7db7-c219-4251-8a3a-d6a36bfe916b response_code = 200 uri = /baseboard
20112025-01-13T22:46:58.526ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6408 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 4eba690c-4c4b-4875-9e86-338683a1e5d2 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
20122025-01-13T22:47:00.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53385
20132025-01-13T22:47:00.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53385 req_id = 5fc10ae2-8935-459c-88f2-e4153227144b response_code = 200 uri = /vpc-routes
20142025-01-13T22:47:00.863ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20152025-01-13T22:47:00.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53385 req_id = 2b4d1eaa-ae0d-46cd-bc1b-6dc472c54b37 response_code = 204 uri = /eip-gateways
20162025-01-13T22:47:00.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53385 req_id = 8da92fa7-a948-45b7-b879-4c3ad84d5bcb response_code = 204 uri = /vpc-routes
20172025-01-13T22:47:00.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53325
20182025-01-13T22:47:00.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53325 req_id = f13474bf-9c5f-4f9b-a984-02be348cfce7 response_code = 200 uri = /v2p
20192025-01-13T22:47:00.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35077
20202025-01-13T22:47:00.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20212025-01-13T22:47:01.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20222025-01-13T22:47:01.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35077 req_id = ba935fb5-b58e-4e00-9bd9-d4d3ff66e2d1 response_code = 204 uri = /switch-ports
20232025-01-13T22:47:01.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35077 req_id = ffaf5f89-c841-45a3-bf4c-e1c9bc0daa77 response_code = 200 uri = /network-bootstore-config
20242025-01-13T22:47:01.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46196
20252025-01-13T22:47:01.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46196 req_id = 15c955c7-8435-42ea-aa75-115976b4a987 response_code = 200 uri = /vpc-routes
20262025-01-13T22:47:01.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20272025-01-13T22:47:01.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46196 req_id = 711901b8-fde3-43b3-964e-316a2b91acea response_code = 204 uri = /eip-gateways
20282025-01-13T22:47:01.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 448 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46196 req_id = 9d802385-2d21-45c8-8a24-bc4d4c6bcb76 response_code = 204 uri = /vpc-routes
20292025-01-13T22:47:01.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44885
20302025-01-13T22:47:01.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44885 req_id = a0cfc905-9d46-4f3a-b3ac-e2e4249ef45c response_code = 200 uri = /v2p
20312025-01-13T22:47:01.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35487
20322025-01-13T22:47:01.540ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20332025-01-13T22:47:01.576ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20342025-01-13T22:47:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35487 req_id = 394bca5d-f4ea-466d-8342-eaccdffd2ffd response_code = 204 uri = /switch-ports
20352025-01-13T22:47:01.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35487 req_id = 36269c93-a0ea-46d4-9d11-594a781baa74 response_code = 200 uri = /network-bootstore-config
20362025-01-13T22:47:07.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48654
20372025-01-13T22:47:07.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48654 req_id = f9f8722e-dbd2-4114-ab3c-1e865d8417dd response_code = 200 uri = /vpc-routes
20382025-01-13T22:47:07.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20392025-01-13T22:47:07.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48654 req_id = 794f1807-ce0c-42c0-9a4d-6740dd8e4dd0 response_code = 204 uri = /eip-gateways
20402025-01-13T22:47:07.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48654 req_id = 2efd1e82-db88-4abc-850c-25f8211ab7a6 response_code = 204 uri = /vpc-routes
20412025-01-13T22:47:07.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49901
20422025-01-13T22:47:07.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49901 req_id = 95d44c72-4429-432d-bfdd-37632f321eec response_code = 200 uri = /v2p
20432025-01-13T22:47:07.720ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50576
20442025-01-13T22:47:07.720ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20452025-01-13T22:47:07.758ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20462025-01-13T22:47:07.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90574 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50576 req_id = 4ee45b60-c375-4a53-84a6-88b1d66f0b7a response_code = 204 uri = /switch-ports
20472025-01-13T22:47:07.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50576 req_id = a2a49ab6-8e2d-4567-94c1-310d0addd0d0 response_code = 200 uri = /network-bootstore-config
20482025-01-13T22:47:23.583ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38382
20492025-01-13T22:47:23.583ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38382 req_id = a330b82f-9065-4e23-80dc-cc2ead8bce8f response_code = 200 uri = /baseboard
20502025-01-13T22:47:28.526ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6611 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 27668e65-0de9-4d39-ac4d-332300407ac7 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
20512025-01-13T22:47:30.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55970
20522025-01-13T22:47:30.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55970 req_id = 0a0cdc21-33f6-4945-a6f8-26ce2e915522 response_code = 200 uri = /vpc-routes
20532025-01-13T22:47:30.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20542025-01-13T22:47:30.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55970 req_id = 601574e3-ff37-4ba5-b997-f8fae3e89d0e response_code = 204 uri = /eip-gateways
20552025-01-13T22:47:31.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36348
20562025-01-13T22:47:31.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36348 req_id = 26af8b1c-772d-49e6-b7cf-58e5e639f0ce response_code = 200 uri = /v2p
20572025-01-13T22:47:31.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54846
20582025-01-13T22:47:31.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20592025-01-13T22:47:31.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20602025-01-13T22:47:31.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114076 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54846 req_id = ddb37e3a-df78-4a6e-a59d-011c40fdf1c7 response_code = 204 uri = /switch-ports
20612025-01-13T22:47:31.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54846 req_id = 4ddc1fc7-0970-464d-9117-6c503f366d41 response_code = 200 uri = /network-bootstore-config
20622025-01-13T22:47:31.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 452 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55970 req_id = 1d9b4ba9-17ff-4f54-a25b-a795d940a9f8 response_code = 204 uri = /vpc-routes
20632025-01-13T22:47:31.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38481
20642025-01-13T22:47:31.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38481 req_id = 7dc7f7c8-4582-472e-a25f-a102fa979e36 response_code = 200 uri = /vpc-routes
20652025-01-13T22:47:31.527ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20662025-01-13T22:47:31.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38481 req_id = 9754200d-bcd9-4d99-a053-078962411e29 response_code = 204 uri = /eip-gateways
20672025-01-13T22:47:31.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48803
20682025-01-13T22:47:31.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48803 req_id = 4db34557-e950-4a82-9dad-1bd361a35e76 response_code = 200 uri = /v2p
20692025-01-13T22:47:31.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38481 req_id = 14c8d207-9b49-4f22-84c6-5fd38de451e7 response_code = 204 uri = /vpc-routes
20702025-01-13T22:47:31.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59451
20712025-01-13T22:47:31.683ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20722025-01-13T22:47:31.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20732025-01-13T22:47:31.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87135 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59451 req_id = 9f71c5a5-b380-44eb-beda-eaca2a84beb3 response_code = 204 uri = /switch-ports
20742025-01-13T22:47:31.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59451 req_id = 212916ca-7bba-4266-9723-a8c01191180c response_code = 200 uri = /network-bootstore-config
20752025-01-13T22:47:37.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61468
20762025-01-13T22:47:37.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61468 req_id = 25399cf5-ccfa-4472-a865-b8a056f62eed response_code = 200 uri = /vpc-routes
20772025-01-13T22:47:37.556ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20782025-01-13T22:47:37.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61468 req_id = 07b3d4f6-c534-461e-b622-c6f090fb3074 response_code = 204 uri = /eip-gateways
20792025-01-13T22:47:37.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61468 req_id = e046f824-8e65-4f84-8cdc-76eb4886f9f6 response_code = 204 uri = /vpc-routes
20802025-01-13T22:47:37.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39151
20812025-01-13T22:47:37.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39151 req_id = 725da19b-538c-4f7a-b1ca-fdd742509ee7 response_code = 200 uri = /v2p
20822025-01-13T22:47:37.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60764
20832025-01-13T22:47:37.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20842025-01-13T22:47:37.718ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20852025-01-13T22:47:37.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60764 req_id = 990105a2-dbb7-4fb0-af1a-cb6fa4023be2 response_code = 204 uri = /switch-ports
20862025-01-13T22:47:37.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60764 req_id = c0f708de-45f0-41d7-b402-42284e74026a response_code = 200 uri = /network-bootstore-config
20872025-01-13T22:47:53.617ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64459
20882025-01-13T22:47:53.617ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64459 req_id = a44089d1-c2d1-4e81-87c8-b1acc430b1df response_code = 200 uri = /baseboard
20892025-01-13T22:47:58.525ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6261 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = ebb87c17-1b5e-40eb-aed7-1fef6b560475 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
20902025-01-13T22:48:00.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34621
20912025-01-13T22:48:00.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34621 req_id = f4b4997a-ebd6-4e56-ab77-2d8d856db0c8 response_code = 200 uri = /vpc-routes
20922025-01-13T22:48:00.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
20932025-01-13T22:48:00.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34621 req_id = 8eb4e54c-4397-4b82-87d9-6031e642b865 response_code = 204 uri = /eip-gateways
20942025-01-13T22:48:00.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61030
20952025-01-13T22:48:00.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61030 req_id = 1a5c0809-819d-4647-9b96-716c6bacf169 response_code = 200 uri = /v2p
20962025-01-13T22:48:00.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34621 req_id = 7d796bbe-8959-4426-bf56-68186b114962 response_code = 204 uri = /vpc-routes
20972025-01-13T22:48:00.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59403
20982025-01-13T22:48:00.958ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20992025-01-13T22:48:00.996ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21002025-01-13T22:48:01.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59403 req_id = a8fd992a-0bdc-4a9a-8e18-b9266ad52ae9 response_code = 204 uri = /switch-ports
21012025-01-13T22:48:01.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59403 req_id = 87c5635b-02b2-48ca-a64c-d28e62bf0617 response_code = 200 uri = /network-bootstore-config
21022025-01-13T22:48:01.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49294
21032025-01-13T22:48:01.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49294 req_id = e47a03a9-57a7-4467-b0ae-ad6528e661ca response_code = 200 uri = /vpc-routes
21042025-01-13T22:48:01.355ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
21052025-01-13T22:48:01.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49294 req_id = 4549b15e-febd-43ec-9340-a2e729247907 response_code = 204 uri = /eip-gateways
21062025-01-13T22:48:01.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49294 req_id = 54629998-2530-4b86-b1f2-c4aa04d41f1b response_code = 204 uri = /vpc-routes
21072025-01-13T22:48:01.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51607
21082025-01-13T22:48:01.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21092025-01-13T22:48:01.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21102025-01-13T22:48:01.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102447 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51607 req_id = b9c3db59-91d1-47aa-b655-baaa157230b2 response_code = 204 uri = /switch-ports
21112025-01-13T22:48:01.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52751
21122025-01-13T22:48:01.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52751 req_id = 564e555e-ce1e-4a64-88ad-3e166ccf267e response_code = 200 uri = /v2p
21132025-01-13T22:48:01.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51607 req_id = 4d6dcdc6-3c28-4f08-8799-333d75e24749 response_code = 200 uri = /network-bootstore-config
21142025-01-13T22:48:07.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39008
21152025-01-13T22:48:07.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39008 req_id = aea7e40a-b34c-49da-a7eb-b43fa5123fd8 response_code = 200 uri = /vpc-routes
21162025-01-13T22:48:07.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
21172025-01-13T22:48:07.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39008 req_id = b0745d21-fad9-412c-b742-77d052949c6a response_code = 204 uri = /eip-gateways
21182025-01-13T22:48:07.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57412
21192025-01-13T22:48:07.553ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21202025-01-13T22:48:07.593ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21212025-01-13T22:48:07.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57412 req_id = c5518cff-2592-4daf-b34a-b00bd1eb80e5 response_code = 204 uri = /switch-ports
21222025-01-13T22:48:07.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57412 req_id = 26368c77-76d5-48f3-a089-dcdb6239f600 response_code = 200 uri = /network-bootstore-config
21232025-01-13T22:48:07.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39008 req_id = ed176d83-23b0-4eba-a756-41d8bee32e0b response_code = 204 uri = /vpc-routes
21242025-01-13T22:48:07.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52510
21252025-01-13T22:48:07.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52510 req_id = 870f2010-37ed-41cc-b173-46ee2ae24792 response_code = 200 uri = /v2p
21262025-01-13T22:48:23.649ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44339
21272025-01-13T22:48:23.649ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44339 req_id = e45aac4f-a213-417b-a421-33b4d6dc26fa response_code = 200 uri = /baseboard
21282025-01-13T22:48:28.525ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6512 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 0dbdaf65-e64b-48ec-b99b-330ddb647dde response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
21292025-01-13T22:48:30.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62488
21302025-01-13T22:48:30.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62488 req_id = ba921378-4f3c-44a6-9c8c-88addd1dd7d1 response_code = 200 uri = /vpc-routes
21312025-01-13T22:48:30.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
21322025-01-13T22:48:30.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62488 req_id = 82c81d55-668c-415a-9bbb-a9fe19103271 response_code = 204 uri = /eip-gateways
21332025-01-13T22:48:30.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62523
21342025-01-13T22:48:30.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62523 req_id = d9e799df-9f55-4316-875f-20a01626e663 response_code = 200 uri = /v2p
21352025-01-13T22:48:30.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62488 req_id = 13a3b42e-52f6-4a2d-a8b8-7333b92e2404 response_code = 204 uri = /vpc-routes
21362025-01-13T22:48:31.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54226
21372025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21382025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21392025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21402025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21412025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21422025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21432025-01-13T22:48:31.045ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21442025-01-13T22:48:31.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54226 req_id = 3c238484-dba7-4ace-80cc-2ae5aedb167e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21452025-01-13T22:48:31.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37265
21462025-01-13T22:48:31.063ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21472025-01-13T22:48:31.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21482025-01-13T22:48:31.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37265 req_id = b5fb37ea-e910-4931-bf5b-d44841828a62 response_code = 204 uri = /switch-ports
21492025-01-13T22:48:31.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37265 req_id = 2381f813-2649-4e49-989f-ed421a3f8ea8 response_code = 200 uri = /network-bootstore-config
21502025-01-13T22:48:31.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64759
21512025-01-13T22:48:31.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64759 req_id = 489fb26d-017b-4edd-bf70-124e2517be43 response_code = 200 uri = /vpc-routes
21522025-01-13T22:48:31.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
21532025-01-13T22:48:31.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64759 req_id = 67828298-fd95-41c9-846a-346c447efc89 response_code = 204 uri = /eip-gateways
21542025-01-13T22:48:31.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64759 req_id = 4f787091-3899-4dee-bbe8-7b0d378026f0 response_code = 204 uri = /vpc-routes
21552025-01-13T22:48:31.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56535
21562025-01-13T22:48:31.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56535 req_id = e4ebab65-6f4e-40ce-997c-faae8e65f52b response_code = 200 uri = /v2p
21572025-01-13T22:48:31.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61568
21582025-01-13T22:48:31.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21592025-01-13T22:48:31.664ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21602025-01-13T22:48:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61568 req_id = f3a8282b-69d0-4831-9f5e-4fd50aaea491 response_code = 204 uri = /switch-ports
21612025-01-13T22:48:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61568 req_id = c765fdd5-f450-47ab-bb34-d6b276673896 response_code = 200 uri = /network-bootstore-config
21622025-01-13T22:48:31.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52083
21632025-01-13T22:48:31.739ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21642025-01-13T22:48:31.739ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21652025-01-13T22:48:31.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21662025-01-13T22:48:31.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21672025-01-13T22:48:31.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21682025-01-13T22:48:31.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21692025-01-13T22:48:31.740ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21702025-01-13T22:48:31.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 421 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52083 req_id = 6c154d97-8c7c-4e3b-b286-f9648fc384b0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21712025-01-13T22:48:37.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35195
21722025-01-13T22:48:37.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35195 req_id = c6df30fa-c638-4112-8bb6-180c84092002 response_code = 200 uri = /vpc-routes
21732025-01-13T22:48:37.573ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
21742025-01-13T22:48:37.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35195 req_id = fb7be5fe-90c0-4e92-8a59-25cdd32d2f03 response_code = 204 uri = /eip-gateways
21752025-01-13T22:48:37.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35195 req_id = 987dc198-8d77-4ae3-81f7-3cebdb98fde3 response_code = 204 uri = /vpc-routes
21762025-01-13T22:48:37.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45397
21772025-01-13T22:48:37.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45397 req_id = d957e2f2-bdf4-4936-af89-bceea559cd6b response_code = 200 uri = /v2p
21782025-01-13T22:48:37.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63759
21792025-01-13T22:48:37.691ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21802025-01-13T22:48:37.728ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21812025-01-13T22:48:37.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63759 req_id = 1a09ba73-d856-4669-a9c9-3e5c6e38a876 response_code = 204 uri = /switch-ports
21822025-01-13T22:48:37.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63759 req_id = d2d013ab-de31-4989-9c6a-d4001d496131 response_code = 200 uri = /network-bootstore-config
21832025-01-13T22:48:38.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47106
21842025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21852025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21862025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21872025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21882025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21892025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21902025-01-13T22:48:38.004ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21912025-01-13T22:48:38.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47106 req_id = 8680592f-c2e0-406a-a4c2-c7a2c1aec1b9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21922025-01-13T22:48:53.684ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63549
21932025-01-13T22:48:53.684ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63549 req_id = 55ba0b1b-1ed5-4889-b765-73ae2a7ef321 response_code = 200 uri = /baseboard
21942025-01-13T22:48:58.524ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6720 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = df97657f-cd35-401c-867e-17f4e19b0bb5 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
21952025-01-13T22:49:00.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51373
21962025-01-13T22:49:00.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51373 req_id = 97ff656c-dcdc-473e-b91c-6decc2a706ee response_code = 200 uri = /v2p
21972025-01-13T22:49:00.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55372
21982025-01-13T22:49:00.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55372 req_id = 56f106ad-c1e0-4db0-8497-e509d9f50e17 response_code = 200 uri = /vpc-routes
21992025-01-13T22:49:00.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36920
22002025-01-13T22:49:00.858ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22012025-01-13T22:49:00.894ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22022025-01-13T22:49:00.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89490 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36920 req_id = 8571ace9-873d-4f1b-87e0-68cf51d190fb response_code = 204 uri = /switch-ports
22032025-01-13T22:49:00.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22042025-01-13T22:49:00.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55372 req_id = 82e42c9a-240c-4a23-a11c-3dfdf65b79c9 response_code = 204 uri = /eip-gateways
22052025-01-13T22:49:00.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36920 req_id = c26d72c4-a202-4bf8-9fd5-ef5ee8031e08 response_code = 200 uri = /network-bootstore-config
22062025-01-13T22:49:00.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 360 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55372 req_id = dbd2955e-b210-4c08-b4c7-623cd9f20d2d response_code = 204 uri = /vpc-routes
22072025-01-13T22:49:01.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57472
22082025-01-13T22:49:01.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57472 req_id = 8678b622-3f30-455c-b1ca-bcf23848dcd1 response_code = 200 uri = /vpc-routes
22092025-01-13T22:49:01.284ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22102025-01-13T22:49:01.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57472 req_id = 2b61bfd7-e7c1-4224-9f8f-0956f195c83b response_code = 204 uri = /eip-gateways
22112025-01-13T22:49:01.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57472 req_id = 0cb3e59a-1cf2-4275-a002-55e2ccef71e2 response_code = 204 uri = /vpc-routes
22122025-01-13T22:49:01.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33402
22132025-01-13T22:49:01.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22142025-01-13T22:49:01.379ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22152025-01-13T22:49:01.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33402 req_id = 4d9fa983-f370-4d5e-b717-b6723935bd29 response_code = 204 uri = /switch-ports
22162025-01-13T22:49:01.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54510
22172025-01-13T22:49:01.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33402 req_id = c8128cdb-2759-401e-82f6-8e94495ba150 response_code = 200 uri = /network-bootstore-config
22182025-01-13T22:49:01.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54510 req_id = 12cfd06b-8b81-45ea-9432-f1af936388cb response_code = 200 uri = /v2p
22192025-01-13T22:49:07.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64488
22202025-01-13T22:49:07.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64488 req_id = a3f9fccd-5f61-4087-8805-5e25738a2e83 response_code = 200 uri = /vpc-routes
22212025-01-13T22:49:07.564ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22222025-01-13T22:49:07.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64488 req_id = 487afca7-35c0-4d9c-be08-2d51fec50e6d response_code = 204 uri = /eip-gateways
22232025-01-13T22:49:07.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64488 req_id = ee285794-584e-44ac-aa6c-99c5ae47227f response_code = 204 uri = /vpc-routes
22242025-01-13T22:49:07.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50959
22252025-01-13T22:49:07.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50959 req_id = 75cf0e98-ea5a-4a5e-b339-e8168884ed4c response_code = 200 uri = /v2p
22262025-01-13T22:49:07.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53152
22272025-01-13T22:49:07.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22282025-01-13T22:49:07.629ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22292025-01-13T22:49:07.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88294 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53152 req_id = e4e6887f-11db-4362-8b3e-0bb023869af2 response_code = 204 uri = /switch-ports
22302025-01-13T22:49:07.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53152 req_id = 15fd309d-c66e-4876-9951-c35bf7007b39 response_code = 200 uri = /network-bootstore-config
22312025-01-13T22:49:23.717ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45729
22322025-01-13T22:49:23.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45729 req_id = 1910f0ed-1fc0-4ccc-b8b9-681cbd0dc60b response_code = 200 uri = /baseboard
22332025-01-13T22:49:28.524ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6794 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 628cb297-31c7-40dc-8257-982ebe5245c2 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
22342025-01-13T22:49:31.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46254
22352025-01-13T22:49:31.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46254 req_id = 80152f26-7277-42d2-a922-ce87d4f4b3c9 response_code = 200 uri = /vpc-routes
22362025-01-13T22:49:31.187ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22372025-01-13T22:49:31.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46254 req_id = 19557b37-9215-4b13-ace0-3800f8ada74a response_code = 204 uri = /eip-gateways
22382025-01-13T22:49:31.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35497
22392025-01-13T22:49:31.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35497 req_id = 5fc5a14c-e012-452c-984a-8101011d559f response_code = 200 uri = /v2p
22402025-01-13T22:49:31.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46254 req_id = 87923641-6b67-47aa-8c63-742271c3d69b response_code = 204 uri = /vpc-routes
22412025-01-13T22:49:31.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41476
22422025-01-13T22:49:31.382ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22432025-01-13T22:49:31.421ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22442025-01-13T22:49:31.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92518 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41476 req_id = c5a01b13-2ac4-47b0-b234-fa90fd90cfd8 response_code = 204 uri = /switch-ports
22452025-01-13T22:49:31.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41476 req_id = 356803e9-7986-4ede-9258-56bd06262b4f response_code = 200 uri = /network-bootstore-config
22462025-01-13T22:49:31.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52039
22472025-01-13T22:49:31.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52039 req_id = 50999b4b-6b81-4b0c-9605-79b415009e7f response_code = 200 uri = /vpc-routes
22482025-01-13T22:49:31.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22492025-01-13T22:49:31.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52039 req_id = 185e5506-c784-4c9b-8f34-5b7de0f4a69e response_code = 204 uri = /eip-gateways
22502025-01-13T22:49:31.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52039 req_id = 175ed2c5-59d5-4f9c-a8cd-e03d453b0ffc response_code = 204 uri = /vpc-routes
22512025-01-13T22:49:31.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59164
22522025-01-13T22:49:31.627ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22532025-01-13T22:49:31.662ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22542025-01-13T22:49:31.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59164 req_id = 46b34bdb-9672-48c1-b945-5cdb764d11ee response_code = 204 uri = /switch-ports
22552025-01-13T22:49:31.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47701
22562025-01-13T22:49:31.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47701 req_id = c2c146a5-9b1f-4191-bc31-639fe9281518 response_code = 200 uri = /v2p
22572025-01-13T22:49:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59164 req_id = ea5d3b09-3495-4e38-b900-92e726970784 response_code = 200 uri = /network-bootstore-config
22582025-01-13T22:49:37.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36446
22592025-01-13T22:49:37.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36446 req_id = 578459ca-a08b-44ca-a72c-331bacbeac55 response_code = 200 uri = /vpc-routes
22602025-01-13T22:49:37.670ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22612025-01-13T22:49:37.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36446 req_id = 1cdafecc-844e-42c2-8773-fe6e5bdfbdee response_code = 204 uri = /eip-gateways
22622025-01-13T22:49:37.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36446 req_id = 212b405d-fcbf-4409-bd27-87587a812a82 response_code = 204 uri = /vpc-routes
22632025-01-13T22:49:37.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38472
22642025-01-13T22:49:37.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38472 req_id = e1bf1203-0146-494b-bbb4-cb62d9818ba0 response_code = 200 uri = /v2p
22652025-01-13T22:49:37.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43431
22662025-01-13T22:49:37.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22672025-01-13T22:49:37.800ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22682025-01-13T22:49:37.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43431 req_id = 5acef868-03a5-4435-8545-90b88b28a1e7 response_code = 204 uri = /switch-ports
22692025-01-13T22:49:37.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43431 req_id = 99c96ba7-8cd6-4e22-ab02-91f695e4a364 response_code = 200 uri = /network-bootstore-config
22702025-01-13T22:49:53.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51145
22712025-01-13T22:49:53.752ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51145 req_id = e700d620-df00-4869-b8bc-7e0b74cd84e9 response_code = 200 uri = /baseboard
22722025-01-13T22:49:58.523ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6648 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 915872bc-13f6-4fb9-820f-9414c9431147 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
22732025-01-13T22:50:00.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37259
22742025-01-13T22:50:00.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37259 req_id = 7f980205-7967-451e-a20d-89414da3c53d response_code = 200 uri = /vpc-routes
22752025-01-13T22:50:00.787ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22762025-01-13T22:50:00.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37259 req_id = f07a1167-4b71-4aba-96fc-a5a92e100bca response_code = 204 uri = /eip-gateways
22772025-01-13T22:50:00.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37259 req_id = e3d8d9f8-d1c4-44f2-a864-842fed9a5ac7 response_code = 204 uri = /vpc-routes
22782025-01-13T22:50:00.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63193
22792025-01-13T22:50:00.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63193 req_id = e79c5f65-8028-45ed-9e7d-b137936d5ab9 response_code = 200 uri = /v2p
22802025-01-13T22:50:00.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65177
22812025-01-13T22:50:00.983ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22822025-01-13T22:50:01.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22832025-01-13T22:50:01.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65177 req_id = 1d3be766-3c8d-4ac9-872c-daaff4f0805e response_code = 204 uri = /switch-ports
22842025-01-13T22:50:01.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65177 req_id = 8bd06828-406b-4861-9428-0c10ab838e70 response_code = 200 uri = /network-bootstore-config
22852025-01-13T22:50:01.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57021
22862025-01-13T22:50:01.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57021 req_id = 89e2e958-0d12-41ac-bbd7-d104d885ec13 response_code = 200 uri = /vpc-routes
22872025-01-13T22:50:01.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
22882025-01-13T22:50:01.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57021 req_id = 84a9ef7e-2394-4344-abdf-a0b48e5347fd response_code = 204 uri = /eip-gateways
22892025-01-13T22:50:01.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57021 req_id = 15fdd06d-423b-433c-8197-4854d026ac0b response_code = 204 uri = /vpc-routes
22902025-01-13T22:50:01.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56414
22912025-01-13T22:50:01.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56414 req_id = 4c6ab63e-e835-4351-996b-e84813ebded3 response_code = 200 uri = /v2p
22922025-01-13T22:50:01.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48580
22932025-01-13T22:50:01.399ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22942025-01-13T22:50:01.436ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22952025-01-13T22:50:01.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90453 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48580 req_id = 2fc66890-d666-4dfd-855d-6069a70a3848 response_code = 204 uri = /switch-ports
22962025-01-13T22:50:01.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48580 req_id = 69f9ab40-a74a-465d-a52a-fbd4a12e2ab9 response_code = 200 uri = /network-bootstore-config
22972025-01-13T22:50:07.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56336
22982025-01-13T22:50:07.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56336 req_id = fdfcbabb-be5f-4307-a9ec-a42170c4f313 response_code = 200 uri = /v2p
22992025-01-13T22:50:07.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46842
23002025-01-13T22:50:07.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46842 req_id = 029d4a48-2efe-4bc9-8028-eaa0453e56ad response_code = 200 uri = /vpc-routes
23012025-01-13T22:50:07.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23022025-01-13T22:50:07.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46842 req_id = a2287902-229b-44ae-95d9-886a0240384a response_code = 204 uri = /eip-gateways
23032025-01-13T22:50:07.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46842 req_id = addf9e68-80ec-45f5-ac10-942213b583d5 response_code = 204 uri = /vpc-routes
23042025-01-13T22:50:07.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52813
23052025-01-13T22:50:07.613ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23062025-01-13T22:50:07.652ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23072025-01-13T22:50:07.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52813 req_id = 23f05adf-95b7-457c-bda4-4da662bb7249 response_code = 204 uri = /switch-ports
23082025-01-13T22:50:07.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52813 req_id = 206b3845-cc14-4aff-8410-510f2174112b response_code = 200 uri = /network-bootstore-config
23092025-01-13T22:50:23.785ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37623
23102025-01-13T22:50:23.786ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37623 req_id = 27eb0134-f20f-46bd-8df2-ea689a34468f response_code = 200 uri = /baseboard
23112025-01-13T22:50:25.675ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23122025-01-13T22:50:25.675ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23132025-01-13T22:50:25.706ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 3685, tv_nsec: 331906995 } time_to_next_cleanup = 599.99999739s
23142025-01-13T22:50:28.524ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7155 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = e0211cd4-fc16-4171-bb85-9ac44b06ff7e response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
23152025-01-13T22:50:30.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38284
23162025-01-13T22:50:30.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38284 req_id = b3be3482-62fd-408d-be42-e3cc6af505ff response_code = 200 uri = /vpc-routes
23172025-01-13T22:50:30.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43513
23182025-01-13T22:50:30.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43513 req_id = 8f42335a-770c-4a83-bf08-b08cd5c2ebe3 response_code = 200 uri = /v2p
23192025-01-13T22:50:30.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23202025-01-13T22:50:30.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38284 req_id = 4be37f84-22ae-41f0-916b-35d5b3e82b19 response_code = 204 uri = /eip-gateways
23212025-01-13T22:50:30.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38284 req_id = d4f187b2-7863-408f-bdf2-e1c94d5d27af response_code = 204 uri = /vpc-routes
23222025-01-13T22:50:31.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45659
23232025-01-13T22:50:31.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23242025-01-13T22:50:31.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23252025-01-13T22:50:31.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108084 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45659 req_id = d62bed0b-3b28-472b-a2ea-a3d47e50f5c4 response_code = 204 uri = /switch-ports
23262025-01-13T22:50:31.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45659 req_id = a9b2426c-e43d-4d31-bd54-0999b36d98ab response_code = 200 uri = /network-bootstore-config
23272025-01-13T22:50:31.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40356
23282025-01-13T22:50:31.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40356 req_id = 8439a9df-9893-493f-b9f8-9a2fb183929a response_code = 200 uri = /vpc-routes
23292025-01-13T22:50:31.468ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23302025-01-13T22:50:31.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40356 req_id = ae032381-d2ef-4093-ac5d-8fabb3b486be response_code = 204 uri = /eip-gateways
23312025-01-13T22:50:31.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63346
23322025-01-13T22:50:31.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63346 req_id = 179a0c3f-e9d6-4932-9b50-30f4e4730e5b response_code = 200 uri = /v2p
23332025-01-13T22:50:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40356 req_id = 404c2faf-011e-4721-9746-2c2f05076245 response_code = 204 uri = /vpc-routes
23342025-01-13T22:50:31.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59046
23352025-01-13T22:50:31.646ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23362025-01-13T22:50:31.684ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23372025-01-13T22:50:31.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59046 req_id = 91e38ff6-2240-4699-91b0-fa9b3a9b6b9c response_code = 204 uri = /switch-ports
23382025-01-13T22:50:31.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59046 req_id = 38ae876d-29e7-44d6-915b-c49c27161efe response_code = 200 uri = /network-bootstore-config
23392025-01-13T22:50:37.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53884
23402025-01-13T22:50:37.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53884 req_id = 4b9d9143-08fe-4006-9e1e-39607b0fe09b response_code = 200 uri = /vpc-routes
23412025-01-13T22:50:37.611ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23422025-01-13T22:50:37.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53884 req_id = 2515cb22-69b3-4bca-8af3-5fe7a8161f9c response_code = 204 uri = /eip-gateways
23432025-01-13T22:50:37.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53884 req_id = 04131523-f845-49d4-be10-44db6b8e973e response_code = 204 uri = /vpc-routes
23442025-01-13T22:50:37.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38576
23452025-01-13T22:50:37.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38576 req_id = cfb952d5-00e4-4f54-8d0c-6aa96d1e8781 response_code = 200 uri = /v2p
23462025-01-13T22:50:37.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65160
23472025-01-13T22:50:37.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23482025-01-13T22:50:38.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23492025-01-13T22:50:38.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65160 req_id = d6b176fa-c2b5-4ef0-addc-d886e7a1a698 response_code = 204 uri = /switch-ports
23502025-01-13T22:50:38.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65160 req_id = d4945bca-1d1d-4e16-abbd-e59ab2c8248b response_code = 200 uri = /network-bootstore-config
23512025-01-13T22:50:39.876ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23522025-01-13T22:50:53.819ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35794
23532025-01-13T22:50:53.819ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35794 req_id = 6e6bf654-2844-48cd-99db-7fe90dc2021b response_code = 200 uri = /baseboard
23542025-01-13T22:50:58.523ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6292 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = e689ce85-15ba-4ec7-829f-27934f0df911 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
23552025-01-13T22:51:00.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64988
23562025-01-13T22:51:00.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64988 req_id = 4a79ba72-6570-4260-81b1-ed08a5142d4e response_code = 200 uri = /vpc-routes
23572025-01-13T22:51:00.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23582025-01-13T22:51:00.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64988 req_id = 7ae3eccb-4781-4849-bee1-ee237743e9bf response_code = 204 uri = /eip-gateways
23592025-01-13T22:51:00.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60012
23602025-01-13T22:51:00.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60012 req_id = 63805731-e2e0-4ac3-8e18-172e6ae7e27f response_code = 200 uri = /v2p
23612025-01-13T22:51:00.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64988 req_id = 742958fa-96e0-4ff8-9488-d909c41860d8 response_code = 204 uri = /vpc-routes
23622025-01-13T22:51:00.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56141
23632025-01-13T22:51:00.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23642025-01-13T22:51:00.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23652025-01-13T22:51:01.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56141 req_id = d4942514-5eca-443e-b8d7-2ceba4c250d6 response_code = 204 uri = /switch-ports
23662025-01-13T22:51:01.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56141 req_id = a60b7264-206d-4519-bcfd-37e02adf2446 response_code = 200 uri = /network-bootstore-config
23672025-01-13T22:51:01.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47153
23682025-01-13T22:51:01.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47153 req_id = 2c31ca52-2bf3-43a9-bcd8-220c42b5379d response_code = 200 uri = /vpc-routes
23692025-01-13T22:51:01.351ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23702025-01-13T22:51:01.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47153 req_id = 791935dc-b53b-466a-ae1c-1dd191c724ff response_code = 204 uri = /eip-gateways
23712025-01-13T22:51:01.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39435
23722025-01-13T22:51:01.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39435 req_id = 4ee76cce-052b-45dd-a724-21f61a4f9942 response_code = 200 uri = /v2p
23732025-01-13T22:51:01.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47153 req_id = 06912145-2c47-4e0f-9248-ac7a6586ee99 response_code = 204 uri = /vpc-routes
23742025-01-13T22:51:01.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46080
23752025-01-13T22:51:01.503ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23762025-01-13T22:51:01.539ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23772025-01-13T22:51:01.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46080 req_id = 878fa28b-89f3-43fa-88cd-291c16a71939 response_code = 204 uri = /switch-ports
23782025-01-13T22:51:01.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46080 req_id = fe7786ea-e363-402c-b9c5-7d94cfd92135 response_code = 200 uri = /network-bootstore-config
23792025-01-13T22:51:07.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46522
23802025-01-13T22:51:07.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46522 req_id = 1f176740-f36b-4b74-8a2e-bf09f8a3d3cb response_code = 200 uri = /vpc-routes
23812025-01-13T22:51:07.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45067
23822025-01-13T22:51:07.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45067 req_id = b8003d7b-7c4a-413b-b223-0e130384b54f response_code = 200 uri = /v2p
23832025-01-13T22:51:07.490ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23842025-01-13T22:51:07.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46522 req_id = ec46168c-5380-4ddd-a5ed-a9db8b326879 response_code = 204 uri = /eip-gateways
23852025-01-13T22:51:07.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46522 req_id = e4819d00-8371-4a6a-b672-0fded070d645 response_code = 204 uri = /vpc-routes
23862025-01-13T22:51:07.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33317
23872025-01-13T22:51:07.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23882025-01-13T22:51:07.645ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23892025-01-13T22:51:07.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33317 req_id = db0469fd-63ff-4a37-a202-5dfc46e41378 response_code = 204 uri = /switch-ports
23902025-01-13T22:51:07.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33317 req_id = 2b4d0966-0e22-4006-bef8-b17ef8efb05d response_code = 200 uri = /network-bootstore-config
23912025-01-13T22:51:23.851ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64240
23922025-01-13T22:51:23.851ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64240 req_id = 0dbb0b0f-aaf0-440d-b3aa-48c66290f01f response_code = 200 uri = /baseboard
23932025-01-13T22:51:28.525ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8711 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 982378c1-9b3b-4a07-953c-a066ca769549 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
23942025-01-13T22:51:30.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43245
23952025-01-13T22:51:30.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43245 req_id = 3fb63e0d-1f00-410d-a79d-4c2d6f4ea8bf response_code = 200 uri = /vpc-routes
23962025-01-13T22:51:30.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
23972025-01-13T22:51:30.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43245 req_id = 812ade46-6246-43c8-af70-9f8ee60677b1 response_code = 204 uri = /eip-gateways
23982025-01-13T22:51:30.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43245 req_id = 3d53e66d-61af-4a18-84c1-abdab821099e response_code = 204 uri = /vpc-routes
23992025-01-13T22:51:31.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40163
24002025-01-13T22:51:31.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24012025-01-13T22:51:31.082ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24022025-01-13T22:51:31.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127925 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40163 req_id = c6b4e8bb-debc-451c-a126-116f715fc819 response_code = 204 uri = /switch-ports
24032025-01-13T22:51:31.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59164
24042025-01-13T22:51:31.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40163 req_id = 59454653-9212-4a5f-a2e1-fd37d973748e response_code = 200 uri = /network-bootstore-config
24052025-01-13T22:51:31.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59164 req_id = 287babbe-b13d-41e5-b0d9-735a7ccc1da5 response_code = 200 uri = /v2p
24062025-01-13T22:51:31.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35971
24072025-01-13T22:51:31.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35971 req_id = 40424006-1ed0-4e17-988d-d91f7bc12a6a response_code = 200 uri = /vpc-routes
24082025-01-13T22:51:31.322ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24092025-01-13T22:51:31.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35971 req_id = 028a6f60-6dc6-4cce-b06d-571c79486487 response_code = 204 uri = /eip-gateways
24102025-01-13T22:51:31.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35971 req_id = fa34fae0-0c14-4917-981d-6e099d9dc236 response_code = 204 uri = /vpc-routes
24112025-01-13T22:51:31.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34598
24122025-01-13T22:51:31.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34598 req_id = 179c05e9-1130-4fa3-9ad7-079419b21dc9 response_code = 200 uri = /v2p
24132025-01-13T22:51:31.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51183
24142025-01-13T22:51:31.532ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24152025-01-13T22:51:31.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24162025-01-13T22:51:31.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51183 req_id = 5daf464a-d617-4600-af3c-423cc761f785 response_code = 204 uri = /switch-ports
24172025-01-13T22:51:31.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51183 req_id = 88e42740-e6f2-407a-82e8-bb9e20c4f7de response_code = 200 uri = /network-bootstore-config
24182025-01-13T22:51:37.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34925
24192025-01-13T22:51:37.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34925 req_id = f3293894-6e2b-46ae-beab-a6f14c055b20 response_code = 200 uri = /vpc-routes
24202025-01-13T22:51:37.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57793
24212025-01-13T22:51:37.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57793 req_id = da0b94a9-7d16-400c-b546-3a00a0dd0e51 response_code = 200 uri = /v2p
24222025-01-13T22:51:37.681ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24232025-01-13T22:51:37.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34925 req_id = e8c16f71-0617-454e-be2b-7d3bc5e42d7f response_code = 204 uri = /eip-gateways
24242025-01-13T22:51:37.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34925 req_id = 369fa848-5cc9-4e0a-a5fd-ad65112c2b4b response_code = 204 uri = /vpc-routes
24252025-01-13T22:51:37.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50182
24262025-01-13T22:51:37.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24272025-01-13T22:51:37.847ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24282025-01-13T22:51:37.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50182 req_id = 9a6b822b-47ce-4f4e-817a-937f531fce22 response_code = 204 uri = /switch-ports
24292025-01-13T22:51:37.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50182 req_id = 253d9a79-6b39-4246-a2b5-8d7c87e00527 response_code = 200 uri = /network-bootstore-config
24302025-01-13T22:51:53.885ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40648
24312025-01-13T22:51:53.885ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40648 req_id = 5f469067-74ec-405f-946e-7babb71b8a98 response_code = 200 uri = /baseboard
24322025-01-13T22:51:58.523ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6654 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 2c731711-9cd5-4170-adb0-2b281229966f response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
24332025-01-13T22:52:00.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49643
24342025-01-13T22:52:00.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49643 req_id = 0c62b23b-02b1-401f-985c-0c317108e8a4 response_code = 200 uri = /vpc-routes
24352025-01-13T22:52:00.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24362025-01-13T22:52:00.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49643 req_id = 235944e2-5d8f-4de7-b30f-c4ddec870bfa response_code = 204 uri = /eip-gateways
24372025-01-13T22:52:00.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49482
24382025-01-13T22:52:00.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49482 req_id = 16a5b295-a4d3-4d2d-9adf-937460082af9 response_code = 200 uri = /v2p
24392025-01-13T22:52:00.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49643 req_id = c18cb641-83ba-4bdf-b322-92e893893a3f response_code = 204 uri = /vpc-routes
24402025-01-13T22:52:00.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59896
24412025-01-13T22:52:00.924ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24422025-01-13T22:52:00.963ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24432025-01-13T22:52:01.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 610add38-3f3d-45c6-9a35-7ab7fda91e74 response_code = 204 uri = /switch-ports
24442025-01-13T22:52:01.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59896 req_id = 2aa37f2b-2302-4277-927a-c4425370329d response_code = 200 uri = /network-bootstore-config
24452025-01-13T22:52:01.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50577
24462025-01-13T22:52:01.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50577 req_id = ed9e56e7-29a9-4e8d-851b-4c1e921d44ec response_code = 200 uri = /vpc-routes
24472025-01-13T22:52:01.413ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24482025-01-13T22:52:01.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50577 req_id = 9be8e329-4f82-43fc-8bfc-f618da6ddfa7 response_code = 204 uri = /eip-gateways
24492025-01-13T22:52:01.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50577 req_id = b3797185-8471-4f6f-a40a-88a222ede161 response_code = 204 uri = /vpc-routes
24502025-01-13T22:52:01.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48691
24512025-01-13T22:52:01.429ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24522025-01-13T22:52:01.465ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24532025-01-13T22:52:01.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48691 req_id = e5a1d833-5017-4015-8669-f2e4e7b51e32 response_code = 204 uri = /switch-ports
24542025-01-13T22:52:01.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34655
24552025-01-13T22:52:01.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34655 req_id = 4237029b-cccc-457b-9357-5c517be4d2a1 response_code = 200 uri = /v2p
24562025-01-13T22:52:01.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48691 req_id = e4b753cb-42da-4745-bf73-a4b5c20ba13f response_code = 200 uri = /network-bootstore-config
24572025-01-13T22:52:07.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33146
24582025-01-13T22:52:07.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33146 req_id = 4f3e2783-e271-447b-9c79-3ac8f901b710 response_code = 200 uri = /vpc-routes
24592025-01-13T22:52:07.389ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24602025-01-13T22:52:07.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33146 req_id = b69ae8c4-197f-4ec4-84a8-6d22e40aefb5 response_code = 204 uri = /eip-gateways
24612025-01-13T22:52:07.461ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36934
24622025-01-13T22:52:07.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36934 req_id = fc80290b-c175-4c43-b514-a234ea1d00e8 response_code = 200 uri = /v2p
24632025-01-13T22:52:07.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33146 req_id = 7fa4e36a-0cd4-4fb0-b510-42adfd98ca41 response_code = 204 uri = /vpc-routes
24642025-01-13T22:52:07.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35214
24652025-01-13T22:52:07.545ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24662025-01-13T22:52:07.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24672025-01-13T22:52:07.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35214 req_id = cc3d800f-ad8a-47d3-a4de-c17c64d6ce26 response_code = 204 uri = /switch-ports
24682025-01-13T22:52:07.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35214 req_id = fc72758f-eafa-4d35-9b29-946938bc684a response_code = 200 uri = /network-bootstore-config
24692025-01-13T22:52:23.919ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55802
24702025-01-13T22:52:23.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55802 req_id = ed7f46b0-ccbe-47d4-a9de-82704209b608 response_code = 200 uri = /baseboard
24712025-01-13T22:52:28.522ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6655 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 876b0741-12b4-43da-aafd-d8ef5e545716 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
24722025-01-13T22:52:30.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47151
24732025-01-13T22:52:30.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47151 req_id = 2423f37c-010b-4cc8-a5e2-258b5011b169 response_code = 200 uri = /vpc-routes
24742025-01-13T22:52:30.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50213
24752025-01-13T22:52:30.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50213 req_id = 888fdedc-6d35-4abd-a29b-18a360d3afde response_code = 200 uri = /v2p
24762025-01-13T22:52:31.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24772025-01-13T22:52:31.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47151 req_id = a34b86f7-bf52-44d7-a02d-11972f11137c response_code = 204 uri = /eip-gateways
24782025-01-13T22:52:31.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47151 req_id = 560f0332-1665-41b7-8e5a-98a8d4904a45 response_code = 204 uri = /vpc-routes
24792025-01-13T22:52:31.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42451
24802025-01-13T22:52:31.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24812025-01-13T22:52:31.259ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24822025-01-13T22:52:31.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42451 req_id = c4e0d4db-e1bf-46a5-8c90-44532ad25dbb response_code = 204 uri = /switch-ports
24832025-01-13T22:52:31.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42451 req_id = 757cd6da-86d3-4d80-a897-9a32f9dfc23a response_code = 200 uri = /network-bootstore-config
24842025-01-13T22:52:31.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64701
24852025-01-13T22:52:31.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64701 req_id = 3aaffe54-9c3b-4980-8617-2ae701a59d0c response_code = 200 uri = /vpc-routes
24862025-01-13T22:52:31.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
24872025-01-13T22:52:31.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64701 req_id = 7f253ea9-def1-48f8-a668-e31e76dab19e response_code = 204 uri = /eip-gateways
24882025-01-13T22:52:31.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64701 req_id = af30767e-49f3-47f1-a411-2c44a1f9acdf response_code = 204 uri = /vpc-routes
24892025-01-13T22:52:31.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45366
24902025-01-13T22:52:31.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45366 req_id = 4de58831-624d-4be5-a7a0-471744b25dd5 response_code = 200 uri = /v2p
24912025-01-13T22:52:31.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44799
24922025-01-13T22:52:31.651ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24932025-01-13T22:52:31.686ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24942025-01-13T22:52:31.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89810 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44799 req_id = a3a054a4-4c6d-404f-a921-11d151e7930a response_code = 204 uri = /switch-ports
24952025-01-13T22:52:31.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44799 req_id = e6e6d184-6a82-47ba-a924-b40c93e32f55 response_code = 200 uri = /network-bootstore-config
24962025-01-13T22:52:37.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47784
24972025-01-13T22:52:37.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47784 req_id = e83cf0b3-f9a6-4bf6-b1ae-af6ba65d9c91 response_code = 200 uri = /v2p
24982025-01-13T22:52:37.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49835
24992025-01-13T22:52:37.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49835 req_id = 72730589-2c25-4095-9fb6-a8a40ecda7c2 response_code = 200 uri = /vpc-routes
25002025-01-13T22:52:37.738ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25012025-01-13T22:52:37.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49835 req_id = 741015cb-c4b2-4f6b-84b0-f1782745fd2a response_code = 204 uri = /eip-gateways
25022025-01-13T22:52:37.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49835 req_id = fc4489c3-070c-4b2a-802f-727382e7c014 response_code = 204 uri = /vpc-routes
25032025-01-13T22:52:37.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64878
25042025-01-13T22:52:37.776ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25052025-01-13T22:52:37.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25062025-01-13T22:52:37.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94557 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64878 req_id = 99e57a86-905f-40a4-a59f-fe5d6f49dfc8 response_code = 204 uri = /switch-ports
25072025-01-13T22:52:37.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64878 req_id = 66b509a0-c44a-42c6-8dcb-401a715de9c0 response_code = 200 uri = /network-bootstore-config
25082025-01-13T22:52:53.951ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37793
25092025-01-13T22:52:53.951ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37793 req_id = f05917b1-8e8a-453c-be04-bd83ba24f9f4 response_code = 200 uri = /baseboard
25102025-01-13T22:52:58.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6412 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 285dba6c-3af0-43f1-95ea-b1b6b1b8deb0 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
25112025-01-13T22:53:00.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38328
25122025-01-13T22:53:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38328 req_id = 5c8d23cf-3b42-4a11-a4b0-667b199548e0 response_code = 200 uri = /vpc-routes
25132025-01-13T22:53:00.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25142025-01-13T22:53:00.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38328 req_id = fcb4ccf3-af6a-4edb-be56-6a795c394cde response_code = 204 uri = /eip-gateways
25152025-01-13T22:53:00.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38328 req_id = 6bec76ef-873e-4d86-a257-744b75520f42 response_code = 204 uri = /vpc-routes
25162025-01-13T22:53:00.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63031
25172025-01-13T22:53:00.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63031 req_id = b02510b8-90fb-4d7a-bced-b95cf06e01ba response_code = 200 uri = /v2p
25182025-01-13T22:53:00.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46179
25192025-01-13T22:53:00.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25202025-01-13T22:53:01.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25212025-01-13T22:53:01.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46179 req_id = e133c1fa-5e52-4152-bd9d-410031df90e4 response_code = 204 uri = /switch-ports
25222025-01-13T22:53:01.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46179 req_id = ca6ed393-7e8e-433a-8722-7616240cb898 response_code = 200 uri = /network-bootstore-config
25232025-01-13T22:53:01.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38159
25242025-01-13T22:53:01.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38159 req_id = 413b8a68-06c5-49e2-9a18-7e3eb33057ad response_code = 200 uri = /vpc-routes
25252025-01-13T22:53:01.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25262025-01-13T22:53:01.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38159 req_id = 500de1a2-7ecd-44a3-8954-bd0fafa96952 response_code = 204 uri = /eip-gateways
25272025-01-13T22:53:01.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38159 req_id = 0480e02c-72e1-45d0-a438-683b488fd3e7 response_code = 204 uri = /vpc-routes
25282025-01-13T22:53:01.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50696
25292025-01-13T22:53:01.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50696 req_id = 5cab26e6-d6ad-4d44-93ed-d26687cfe13e response_code = 200 uri = /v2p
25302025-01-13T22:53:01.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35164
25312025-01-13T22:53:01.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25322025-01-13T22:53:01.460ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25332025-01-13T22:53:01.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89559 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35164 req_id = cfbd5fac-1900-4c26-91b7-8a3abc784563 response_code = 204 uri = /switch-ports
25342025-01-13T22:53:01.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35164 req_id = d1eff866-d4e5-419e-a4ba-6fbfea630ae4 response_code = 200 uri = /network-bootstore-config
25352025-01-13T22:53:07.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54702
25362025-01-13T22:53:07.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54702 req_id = 17e55fbc-c056-4ed6-ae03-f7d1976c3f47 response_code = 200 uri = /vpc-routes
25372025-01-13T22:53:07.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25382025-01-13T22:53:07.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54702 req_id = d8464819-dd32-4270-a553-c2aff4449903 response_code = 204 uri = /eip-gateways
25392025-01-13T22:53:07.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40018
25402025-01-13T22:53:07.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40018 req_id = 17e5267a-5ef6-4c47-8b3d-67d7c2f3bf0c response_code = 200 uri = /v2p
25412025-01-13T22:53:07.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54702 req_id = 0aeeb632-4a5f-41db-a558-88f08a75cf54 response_code = 204 uri = /vpc-routes
25422025-01-13T22:53:07.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46189
25432025-01-13T22:53:07.560ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25442025-01-13T22:53:07.598ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25452025-01-13T22:53:07.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90327 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46189 req_id = 6940070b-4e6e-4149-8c04-c6fc4612fce9 response_code = 204 uri = /switch-ports
25462025-01-13T22:53:07.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46189 req_id = 4994fb82-e11a-41cb-9739-27a33dcbce18 response_code = 200 uri = /network-bootstore-config
25472025-01-13T22:53:23.983ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49278
25482025-01-13T22:53:23.983ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49278 req_id = 1d4f452e-2f08-4f6f-b0a6-b73c0cc148d1 response_code = 200 uri = /baseboard
25492025-01-13T22:53:28.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6482 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = b0bb1a82-2b0c-4704-94a6-cb4be083f865 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
25502025-01-13T22:53:31.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42992
25512025-01-13T22:53:31.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42992 req_id = 33944264-e49c-4b13-8ef5-448505b6e1c2 response_code = 200 uri = /vpc-routes
25522025-01-13T22:53:31.021ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25532025-01-13T22:53:31.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42992 req_id = a99b3112-573c-4ef8-8784-e7312ab1e431 response_code = 204 uri = /eip-gateways
25542025-01-13T22:53:31.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47235
25552025-01-13T22:53:31.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25562025-01-13T22:53:31.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25572025-01-13T22:53:31.134ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
25582025-01-13T22:53:31.134ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
25592025-01-13T22:53:31.149ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25602025-01-13T22:53:31.149ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e
25612025-01-13T22:53:31.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63651
25622025-01-13T22:53:31.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63651 req_id = f7d21f8d-81cd-4a4f-8934-ffb633656280 response_code = 200 uri = /v2p
25632025-01-13T22:53:31.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42992 req_id = 426a3e03-a23e-4e3e-84f9-b53919c273a9 response_code = 204 uri = /vpc-routes
25642025-01-13T22:53:31.178ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25652025-01-13T22:53:31.178ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612
25662025-01-13T22:53:31.205ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25672025-01-13T22:53:31.205ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a
25682025-01-13T22:53:31.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62802
25692025-01-13T22:53:31.209ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25702025-01-13T22:53:31.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25712025-01-13T22:53:31.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68c5966c-8942-45eb-a621-8fc500b81f8f
25722025-01-13T22:53:31.256ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25732025-01-13T22:53:31.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25742025-01-13T22:53:31.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250
25752025-01-13T22:53:31.296ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25762025-01-13T22:53:31.296ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9260d14e-3165-43af-a297-8b2685485aec
25772025-01-13T22:53:31.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38431
25782025-01-13T22:53:31.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38431 req_id = 6dca3407-0b74-426b-aad6-e54575f5e754 response_code = 200 uri = /vpc-routes
25792025-01-13T22:53:31.326ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25802025-01-13T22:53:31.326ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477
25812025-01-13T22:53:31.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132341 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62802 req_id = 49a824d3-f648-41d7-a8a5-3784313014bf response_code = 204 uri = /switch-ports
25822025-01-13T22:53:31.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62802 req_id = e8043d0f-f756-4898-aa28-899a048b750c response_code = 200 uri = /network-bootstore-config
25832025-01-13T22:53:31.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38945
25842025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25852025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25862025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25872025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25882025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25892025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25902025-01-13T22:53:31.365ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25912025-01-13T22:53:31.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38945 req_id = c8095c7c-ce29-41a9-8202-dc126ceca236 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25922025-01-13T22:53:31.366ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25932025-01-13T22:53:31.366ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447
25942025-01-13T22:53:31.394ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
25952025-01-13T22:53:31.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38431 req_id = 9fac61a6-bf5e-4890-92bd-89438d5ea86a response_code = 204 uri = /eip-gateways
25962025-01-13T22:53:31.401ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25972025-01-13T22:53:31.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab
25982025-01-13T22:53:31.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38431 req_id = 82926a90-6ce6-4f4a-825c-e99c9bd9f92d response_code = 204 uri = /vpc-routes
25992025-01-13T22:53:31.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286829 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47235 req_id = 4e384c97-0f13-4382-8714-a6df8dc1055d response_code = 200 uri = /inventory
26002025-01-13T22:53:31.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50986
26012025-01-13T22:53:31.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26022025-01-13T22:53:31.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26032025-01-13T22:53:31.593ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
26042025-01-13T22:53:31.593ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
26052025-01-13T22:53:31.610ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26062025-01-13T22:53:31.610ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e
26072025-01-13T22:53:31.646ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26082025-01-13T22:53:31.646ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612
26092025-01-13T22:53:31.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46034
26102025-01-13T22:53:31.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26112025-01-13T22:53:31.677ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26122025-01-13T22:53:31.678ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a
26132025-01-13T22:53:31.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26142025-01-13T22:53:31.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68c5966c-8942-45eb-a621-8fc500b81f8f
26152025-01-13T22:53:31.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26162025-01-13T22:53:31.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55727
26172025-01-13T22:53:31.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 475 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55727 req_id = 59299548-49a8-4d28-87fa-b496d79aa101 response_code = 200 uri = /v2p
26182025-01-13T22:53:31.730ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26192025-01-13T22:53:31.730ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250
26202025-01-13T22:53:31.754ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26212025-01-13T22:53:31.754ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9260d14e-3165-43af-a297-8b2685485aec
26222025-01-13T22:53:31.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46034 req_id = a4ea6558-a8d3-478b-9dfb-82aea6f292e3 response_code = 204 uri = /switch-ports
26232025-01-13T22:53:31.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46034 req_id = 26ddd979-0219-4abe-bfb0-230848d53d1c response_code = 200 uri = /network-bootstore-config
26242025-01-13T22:53:31.779ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252025-01-13T22:53:31.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477
26262025-01-13T22:53:31.804ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272025-01-13T22:53:31.804ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447
26282025-01-13T22:53:31.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-01-13T22:53:31.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab
26302025-01-13T22:53:31.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245359 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50986 req_id = 487aa0dc-d190-40fd-a01b-3a3fba3d1267 response_code = 200 uri = /inventory
26312025-01-13T22:53:31.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45652
26322025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26332025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26342025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26352025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26362025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26372025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26382025-01-13T22:53:31.863ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26392025-01-13T22:53:31.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45652 req_id = 863a9cdc-db35-4be9-9f7e-04dfabd222a6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26402025-01-13T22:53:37.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64331
26412025-01-13T22:53:37.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64331 req_id = 0a6860d6-c731-4e42-ae04-ffc970a98d10 response_code = 200 uri = /vpc-routes
26422025-01-13T22:53:37.550ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
26432025-01-13T22:53:37.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64331 req_id = 2723395d-0ba4-4d6e-af1b-0ceb2cf0c906 response_code = 204 uri = /eip-gateways
26442025-01-13T22:53:37.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64331 req_id = 142aa323-0978-45a0-aa66-4b906a46ea08 response_code = 204 uri = /vpc-routes
26452025-01-13T22:53:37.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47160
26462025-01-13T22:53:37.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26472025-01-13T22:53:37.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26482025-01-13T22:53:37.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98573 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47160 req_id = 2137a2d6-c7b1-486b-b582-1b7c96443506 response_code = 204 uri = /switch-ports
26492025-01-13T22:53:37.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48296
26502025-01-13T22:53:37.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50032
26512025-01-13T22:53:37.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44537
26522025-01-13T22:53:37.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48296 req_id = ea56c1de-3ba8-4fd0-b336-d9de27a8b394 response_code = 200 uri = /v2p
26532025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 2a7b70a5-3659-4735-bd4e-1a08e8a7188b, kind: Service { id: e4c35da2-31ab-4a52-ae76-9faa2bfde5ff }, name: Name("external-dns-e4c35da2-31ab-4a52-ae76-9faa2bfde5ff"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 236, 254])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67068180-6725-4cf3-aad0-d9a7142aa832, kind: Service { id: c912cdb2-0bf8-4986-aea6-c21134511a15 }, name: Name("external-dns-c912cdb2-0bf8-4986-aea6-c21134511a15"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 67])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2b4e76-3c37-4f84-91ca-1b5af4a2158b, kind: Service { id: e2ea1649-0cbb-4e8e-94f3-d1c42484c55f }, name: Name("nexus-e2ea1649-0cbb-4e8e-94f3-d1c42484c55f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61c9d65b-f703-4718-985f-96b29a7ceb8d, kind: Service { id: 36b2613b-f9d1-4d6f-8228-e3a5f78bec0b }, name: Name("nexus-36b2613b-f9d1-4d6f-8228-e3a5f78bec0b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cfbc19b8-4581-4bf2-a83b-f8a634507f25, kind: Service { id: fd7f4520-725e-4f16-b5c4-7e0ce46dabe7 }, name: Name("nexus-fd7f4520-725e-4f16-b5c4-7e0ce46dabe7"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26542025-01-13T22:53:37.770ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26552025-01-13T22:53:37.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47160 req_id = 16a235f5-f31f-4fc6-bdca-9ecbad597866 response_code = 200 uri = /network-bootstore-config
26562025-01-13T22:53:37.770ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26572025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26582025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26592025-01-13T22:53:37.770ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/config/omicron-zones.json file = common/src/ledger.rs:177
26602025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26612025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26622025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26632025-01-13T22:53:37.770ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26642025-01-13T22:53:37.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44537 req_id = 34de4378-c02e-45cc-b97d-64912bfbe13a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26652025-01-13T22:53:37.770ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/config/omicron-zones.json file = common/src/ledger.rs:177
26662025-01-13T22:53:37.782ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f9462a30-27fe-4580-b5c7-e6b29db4082e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672025-01-13T22:53:37.782ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f9462a30-27fe-4580-b5c7-e6b29db4082e
26682025-01-13T22:53:37.806ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e04ca6ed-e3a2-49f0-8742-28ac8c59c612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26692025-01-13T22:53:37.806ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e04ca6ed-e3a2-49f0-8742-28ac8c59c612
26702025-01-13T22:53:37.828ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6b9f0040-8df2-470a-b6be-4b9ecfad0a7a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26712025-01-13T22:53:37.828ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6b9f0040-8df2-470a-b6be-4b9ecfad0a7a
26722025-01-13T22:53:37.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68c5966c-8942-45eb-a621-8fc500b81f8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26732025-01-13T22:53:37.849ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68c5966c-8942-45eb-a621-8fc500b81f8f
26742025-01-13T22:53:37.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 71ff0ddc-96a2-4ac3-9047-4006ab19c250 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26752025-01-13T22:53:37.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_71ff0ddc-96a2-4ac3-9047-4006ab19c250
26762025-01-13T22:53:37.890ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9260d14e-3165-43af-a297-8b2685485aec (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26772025-01-13T22:53:37.890ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9260d14e-3165-43af-a297-8b2685485aec
26782025-01-13T22:53:37.910ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6ac3dafa-9661-403f-ba04-4b699fa2f477 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26792025-01-13T22:53:37.910ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6ac3dafa-9661-403f-ba04-4b699fa2f477
26802025-01-13T22:53:37.930ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4b48fb51-5892-4ad1-8d55-4f1b406b1447 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812025-01-13T22:53:37.930ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4b48fb51-5892-4ad1-8d55-4f1b406b1447
26822025-01-13T22:53:37.953ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 74b10a43-f59e-4444-a4d8-a0efdf3fc3ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26832025-01-13T22:53:37.953ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_74b10a43-f59e-4444-a4d8-a0efdf3fc3ab
26842025-01-13T22:53:37.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50032 req_id = 8bf554b5-8fd8-4de2-aabb-d16b126423da response_code = 200 uri = /inventory
26852025-01-13T22:53:54.016ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35919
26862025-01-13T22:53:54.016ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35919 req_id = c9ddcd22-045c-493c-9270-32f5de231e62 response_code = 200 uri = /baseboard
26872025-01-13T22:53:58.520ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6382 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 9b5ccea0-079d-42ae-9552-2cbb445a15b3 response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
26882025-01-13T22:54:01.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44942
26892025-01-13T22:54:01.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44942 req_id = c92ab284-1dce-4ae4-9cd3-9a6c324e2d4d response_code = 200 uri = /vpc-routes
26902025-01-13T22:54:01.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60885
26912025-01-13T22:54:01.036ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26922025-01-13T22:54:01.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26932025-01-13T22:54:01.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60885 req_id = 7a9704a3-bf35-4002-9221-974541c87b4a response_code = 204 uri = /switch-ports
26942025-01-13T22:54:01.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39398
26952025-01-13T22:54:01.160ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
26962025-01-13T22:54:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44942 req_id = 4059bee7-ce50-437c-977a-5754e63ab6ff response_code = 204 uri = /eip-gateways
26972025-01-13T22:54:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60885 req_id = 240cba81-b877-4d55-931d-f6c8cf919ae9 response_code = 200 uri = /network-bootstore-config
26982025-01-13T22:54:01.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39398 req_id = 79868848-8fa5-47c9-9150-5400ec4276dd response_code = 200 uri = /v2p
26992025-01-13T22:54:01.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44942 req_id = be9bdefa-1716-4922-b695-8b823e2c439d response_code = 204 uri = /vpc-routes
27002025-01-13T22:54:01.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36481
27012025-01-13T22:54:01.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36481 req_id = 808aaa95-5d65-4ca0-8cac-8a4ed936740a response_code = 200 uri = /v2p
27022025-01-13T22:54:01.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39223
27032025-01-13T22:54:01.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39223 req_id = 59b8b30d-ec15-48e2-9b30-e1d854070a3f response_code = 200 uri = /vpc-routes
27042025-01-13T22:54:01.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
27052025-01-13T22:54:01.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39223 req_id = 31274a5e-feba-4856-8af8-c0e95b213ccd response_code = 204 uri = /eip-gateways
27062025-01-13T22:54:01.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39223 req_id = 9a3cabb2-088c-42d8-a29a-ac49086823b4 response_code = 204 uri = /vpc-routes
27072025-01-13T22:54:01.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61494
27082025-01-13T22:54:01.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27092025-01-13T22:54:01.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27102025-01-13T22:54:01.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61494 req_id = 3532efa1-b732-4d94-8f99-d8fa519ff8f4 response_code = 204 uri = /switch-ports
27112025-01-13T22:54:01.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61494 req_id = 5f9e3ad6-bc0d-482d-b67d-e0ae1bb6d9bf response_code = 200 uri = /network-bootstore-config
27122025-01-13T22:54:07.367ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53217
27132025-01-13T22:54:07.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53217 req_id = 851be101-6715-4ab7-8199-e6a90a6d3e99 response_code = 200 uri = /vpc-routes
27142025-01-13T22:54:07.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
27152025-01-13T22:54:07.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53217 req_id = 11b9d968-3cce-4d2f-9e38-1713756ff67b response_code = 204 uri = /eip-gateways
27162025-01-13T22:54:07.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53217 req_id = 72427eda-1f85-40af-a659-559432948043 response_code = 204 uri = /vpc-routes
27172025-01-13T22:54:07.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61773
27182025-01-13T22:54:07.485ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27192025-01-13T22:54:07.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27202025-01-13T22:54:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94256 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61773 req_id = 85876871-0d86-4ee7-b6d6-e324fa041a47 response_code = 204 uri = /switch-ports
27212025-01-13T22:54:07.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51298
27222025-01-13T22:54:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51298 req_id = 90c28cd8-9cf4-4f9b-a9bd-1a4951812084 response_code = 200 uri = /v2p
27232025-01-13T22:54:07.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61773 req_id = 745d0e5b-957a-4574-b88f-948b38b109d4 response_code = 200 uri = /network-bootstore-config
27242025-01-13T22:54:24.049ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38765
27252025-01-13T22:54:24.049ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38765 req_id = 2e08913d-dbf5-4bf5-b011-2249ba44a35e response_code = 200 uri = /baseboard
27262025-01-13T22:54:28.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6719 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 657bd471-8ac0-4c49-ae2b-b846eec1890a response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
27272025-01-13T22:54:31.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58650
27282025-01-13T22:54:31.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58650 req_id = 31189a91-9136-4354-8d66-3062faab32be response_code = 200 uri = /vpc-routes
27292025-01-13T22:54:31.228ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
27302025-01-13T22:54:31.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58650 req_id = 14092e02-e3c6-478b-bdc8-5903bc0f7b2c response_code = 204 uri = /eip-gateways
27312025-01-13T22:54:31.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58650 req_id = c60dec44-141f-479e-820e-3047721d563d response_code = 204 uri = /vpc-routes
27322025-01-13T22:54:31.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41565
27332025-01-13T22:54:31.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27342025-01-13T22:54:31.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27352025-01-13T22:54:31.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41565 req_id = 39e264e4-3786-4fa8-8a5c-00c0b1f668a2 response_code = 204 uri = /switch-ports
27362025-01-13T22:54:31.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56110
27372025-01-13T22:54:31.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56110 req_id = 343beb36-af5a-4768-ac36-b271d104c2b0 response_code = 200 uri = /v2p
27382025-01-13T22:54:31.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41565 req_id = 7894f08e-36a0-4f7d-9886-a8516c634e27 response_code = 200 uri = /network-bootstore-config
27392025-01-13T22:54:31.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35573
27402025-01-13T22:54:31.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35573 req_id = ffe3c2b4-2cdc-4104-be38-0be3777cfcc5 response_code = 200 uri = /v2p
27412025-01-13T22:54:31.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43394
27422025-01-13T22:54:31.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43394 req_id = de164f79-dc44-4192-9a8d-f16bd4fca318 response_code = 200 uri = /vpc-routes
27432025-01-13T22:54:31.592ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
27442025-01-13T22:54:31.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43394 req_id = c0470a66-3e77-4d24-8349-48adca31cae9 response_code = 204 uri = /eip-gateways
27452025-01-13T22:54:31.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43394 req_id = 33b9e635-74d4-47e9-8085-d955e6df6701 response_code = 204 uri = /vpc-routes
27462025-01-13T22:54:31.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35403
27472025-01-13T22:54:31.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27482025-01-13T22:54:31.756ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27492025-01-13T22:54:31.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93784 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35403 req_id = 96fa42d2-f520-43c8-ad03-4cad560de905 response_code = 204 uri = /switch-ports
27502025-01-13T22:54:31.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35403 req_id = 80904df4-e455-4ae2-9435-cdb1b9ae03b5 response_code = 200 uri = /network-bootstore-config
27512025-01-13T22:54:37.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59815
27522025-01-13T22:54:37.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59815 req_id = 3bc6d9de-3115-40ef-aff6-13bbb4bc5d9e response_code = 200 uri = /vpc-routes
27532025-01-13T22:54:37.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57027
27542025-01-13T22:54:37.832ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27552025-01-13T22:54:37.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27562025-01-13T22:54:37.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57027 req_id = be1ae8e4-9946-493a-83d0-815fef2b592b response_code = 204 uri = /switch-ports
27572025-01-13T22:54:37.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54732
27582025-01-13T22:54:37.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
27592025-01-13T22:54:37.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59815 req_id = 8a782e59-4c02-454d-963d-142365e6a580 response_code = 204 uri = /eip-gateways
27602025-01-13T22:54:37.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54732 req_id = b61c81af-d623-4e72-9dca-4145b4a68adf response_code = 200 uri = /v2p
27612025-01-13T22:54:37.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57027 req_id = 2a414f00-21f0-4e71-9a5f-c870882d4590 response_code = 200 uri = /network-bootstore-config
27622025-01-13T22:54:37.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59815 req_id = 8346dd39-6dbb-4b48-8398-0a1416c91693 response_code = 204 uri = /vpc-routes
27632025-01-13T22:54:40.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47132
27642025-01-13T22:54:40.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47132 req_id = 2daf6ae7-d9ed-4983-8ecd-8f3832b7f8ba response_code = 200 uri = /v2p
27652025-01-13T22:54:40.459ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6563737) }
27662025-01-13T22:54:40.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47132 req_id = afa42800-a273-4f37-b72a-2f3017ceed75 response_code = 204 uri = /v2p
27672025-01-13T22:54:40.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65377
27682025-01-13T22:54:40.507ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6563737))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 22ddefbc-7be4-4c26-bff4-188ccc0ab2e2, slot: 0, read_only: false, vcr_json: .., name: "disk-9aee73bec05" }], boot_settings: Some(InstanceBootSettings { order: [22ddefbc-7be4-4c26-bff4-188ccc0ab2e2] }), cloud_init_bytes: Some(..) } instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a metadata = InstanceMetadata { silo_id: 79ea48a0-40b4-4832-a95d-b4390d7ce4ec, project_id: 5ea9249f-2cdc-4d3f-9186-13bf67a3eb30 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-13T22:54:40.492339865Z }
27692025-01-13T22:54:40.507ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a migration_id = None propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27702025-01-13T22:54:40.510ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a migration_id = None propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(6563737))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: d4c1a21e-1d28-4f7c-933a-2d78de20f95e, kind: Instance { id: 740afc4c-5ffb-43cb-b3ca-967a2b0e427a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(6563737), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 22ddefbc-7be4-4c26-bff4-188ccc0ab2e2, slot: 0, read_only: false, vcr_json: .., name: "disk-9aee73bec05" }], boot_settings: Some(InstanceBootSettings { order: [22ddefbc-7be4-4c26-bff4-188ccc0ab2e2] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-13T22:54:40.492339865Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27712025-01-13T22:54:40.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20517 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65377 req_id = e547eab0-de0d-4736-8c79-16c2dcb5a720 response_code = 200 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c
27722025-01-13T22:54:40.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62197
27732025-01-13T22:54:40.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 744 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62197 req_id = 06841615-b046-46cd-8532-3c487ae510cb response_code = 200 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c/state
27742025-01-13T22:54:40.623ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 6563737 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27752025-01-13T22:54:40.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27762025-01-13T22:54:40.662ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c file = illumos-utils/src/zone.rs:325 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27772025-01-13T22:54:40.685ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c file = illumos-utils/src/zone.rs:363 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27782025-01-13T22:54:40.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56207
27792025-01-13T22:54:40.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56207 req_id = ba9ff62d-7c76-4ae0-aeba-55dc4ef3050b response_code = 200 uri = /vpc-routes
27802025-01-13T22:54:40.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {d4c1a21e-1d28-4f7c-933a-2d78de20f95e: {10.151.2.175: {4f33b6ea-4000-437e-a1b6-9210ecc36092}, 10.151.2.176: {4f33b6ea-4000-437e-a1b6-9210ecc36092}}} }
27812025-01-13T22:54:42.308ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27822025-01-13T22:54:42.309ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c zone file = illumos-utils/src/running_zone.rs:488 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27832025-01-13T22:54:42.493ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 54.507721ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27842025-01-13T22:54:42.556ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 72.573802ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27852025-01-13T22:54:42.646ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 102.301117ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27862025-01-13T22:54:42.762ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 555.125194ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27872025-01-13T22:54:43.333ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 671.29944ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27882025-01-13T22:54:44.015ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 596.877834ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27892025-01-13T22:54:44.624ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 1.334182934s file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27902025-01-13T22:54:45.967ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 1.397449448s file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c zone = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
27912025-01-13T22:54:47.394ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c file = sled-agent/src/instance.rs:2067 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27922025-01-13T22:54:47.402ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 59.034368ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27932025-01-13T22:54:47.471ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 110.899675ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27942025-01-13T22:54:47.593ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 143.637039ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27952025-01-13T22:54:47.748ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c") failed: Property not found. retry in 392.945056ms file = illumos-utils/src/svc.rs:36 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27962025-01-13T22:54:48.152ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27972025-01-13T22:54:48.190ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27982025-01-13T22:54:48.331ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
27992025-01-13T22:54:48.331ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
28002025-01-13T22:54:48.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7619113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56207 req_id = c2d32b35-0a11-44d8-809c-20dbb5c06369 response_code = 204 uri = /eip-gateways
28012025-01-13T22:54:48.333ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-13T22:54:48.333101159Z } file = sled-agent/src/instance.rs:780 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28022025-01-13T22:54:48.333ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-13T22:54:48.333101159Z } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28032025-01-13T22:54:48.333ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-13T22:54:48.333101159Z }, migration_in: None, migration_out: None }
28042025-01-13T22:54:48.395ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-13T22:54:48.395411208Z } file = sled-agent/src/instance.rs:780 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28052025-01-13T22:54:48.395ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-13T22:54:48.395411208Z } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28062025-01-13T22:54:48.395ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-13T22:54:48.395411208Z }, migration_in: None, migration_out: None }
28072025-01-13T22:54:48.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56207 req_id = da5fd14a-cceb-4713-8efd-c92477c4b191 response_code = 204 uri = /vpc-routes
28082025-01-13T22:54:54.082ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63619
28092025-01-13T22:54:54.083ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63619 req_id = bf3b30cd-773f-4367-b65f-8ad8005461df response_code = 200 uri = /baseboard
28102025-01-13T22:54:58.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38986
28112025-01-13T22:54:58.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38986 req_id = 9e87f422-cea9-4a08-93fe-95fbdff09b33 response_code = 200 uri = /vmms/ce44805e-b781-43b7-a6a4-15275635b21c/state
28122025-01-13T22:54:58.084ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-13T22:54:58.084616299Z } file = sled-agent/src/instance.rs:780 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28132025-01-13T22:54:58.084ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-13T22:54:58.084616299Z } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28142025-01-13T22:54:58.084ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-13T22:54:58.084616299Z }, migration_in: None, migration_out: None }
28152025-01-13T22:54:58.094ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-13T22:54:58.094719437Z } file = sled-agent/src/instance.rs:780 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28162025-01-13T22:54:58.094ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-13T22:54:58.094719437Z } propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28172025-01-13T22:54:58.094ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28182025-01-13T22:54:58.094ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28192025-01-13T22:54:58.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28202025-01-13T22:54:58.095ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/56697609-d0f2-4d98-a708-6ef6ae2c5907/debug/bundle/zone", "/pool/int/c567ebae-c1ad-4ae4-b2e9-85be19dddc71/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f9462a30-27fe-4580-b5c7-e6b29db4082e/crypt/debug", "/pool/ext/e04ca6ed-e3a2-49f0-8742-28ac8c59c612/crypt/debug", "/pool/ext/6b9f0040-8df2-470a-b6be-4b9ecfad0a7a/crypt/debug", "/pool/ext/68c5966c-8942-45eb-a621-8fc500b81f8f/crypt/debug", "/pool/ext/71ff0ddc-96a2-4ac3-9047-4006ab19c250/crypt/debug", "/pool/ext/9260d14e-3165-43af-a297-8b2685485aec/crypt/debug", "/pool/ext/6ac3dafa-9661-403f-ba04-4b699fa2f477/crypt/debug", "/pool/ext/4b48fb51-5892-4ad1-8d55-4f1b406b1447/crypt/debug", "/pool/ext/74b10a43-f59e-4444-a4d8-a0efdf3fc3ab/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c
28212025-01-13T22:54:58.521ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7458 local_addr = [fd00:1122:3344:101::1]:42873 method = GET remote_addr = [fd00:1122:3344:101::d]:46486 req_id = 2b0c3fbd-cf7a-4661-97df-2c3675418ddd response_code = 200 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b uri = /bd8d50a3-f530-430e-8ded-11b6657cae3b
28222025-01-13T22:54:58.715ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c", bundle_id: cc0dea09-0c63-4443-a9dc-ba04af9bfa2c }, time_created: 2025-01-13T22:54:58.096317207Z, version: 0, cause: TerminatedInstance }
28232025-01-13T22:54:58.715ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_ce44805e-b781-43b7-a6a4-15275635b21c file = sled-agent/src/instance.rs:1313 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28242025-01-13T22:55:00.488ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28252025-01-13T22:55:00.502ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6563737), kind: System }
28262025-01-13T22:55:00.503ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(6563737), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28272025-01-13T22:55:00.503ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T22:55:00.503402261Z }, migration_in: None, migration_out: None }
28282025-01-13T22:55:00.534ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-13T22:55:00.503402261Z }, migration_in: None, migration_out: None }
28292025-01-13T22:55:00.539ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = 740afc4c-5ffb-43cb-b3ca-967a2b0e427a propolis_id = ce44805e-b781-43b7-a6a4-15275635b21c
28302025-01-13T22:55:00.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61736
28312025-01-13T22:55:00.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61736 req_id = a2ce3809-b04e-41ae-bd42-60aa9477e4ce response_code = 200 uri = /vpc-routes
28322025-01-13T22:55:00.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {d4c1a21e-1d28-4f7c-933a-2d78de20f95e: {10.151.2.176: {4f33b6ea-4000-437e-a1b6-9210ecc36092}, 10.151.2.175: {4f33b6ea-4000-437e-a1b6-9210ecc36092}}} }
28332025-01-13T22:55:00.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61736 req_id = eedb1fe6-33a1-4a94-b334-6e855c0ee04a response_code = 204 uri = /eip-gateways
28342025-01-13T22:55:00.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61736 req_id = b0bb6bab-be60-4c05-b6a9-952c563775af response_code = 204 uri = /vpc-routes
28352025-01-13T22:55:00.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65283
28362025-01-13T22:55:00.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28372025-01-13T22:55:00.933ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28382025-01-13T22:55:00.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65283 req_id = 58452fb0-7185-45a7-a6f2-d7e30cd32f08 response_code = 204 uri = /switch-ports
28392025-01-13T22:55:00.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38382
28402025-01-13T22:55:00.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38382 req_id = 9887c239-5fb7-4574-956a-56b8c2459b22 response_code = 200 uri = /v2p
28412025-01-13T22:55:00.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65283 req_id = 2d29cdd6-4110-4c07-9b1e-573c503484c6 response_code = 200 uri = /network-bootstore-config
28422025-01-13T22:55:00.992ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6563737) }
28432025-01-13T22:55:00.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38382 req_id = e649e6b0-5980-4083-a0a0-615e79ee820b response_code = 204 uri = /v2p
28442025-01-13T22:55:01.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60862
28452025-01-13T22:55:01.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60862 req_id = 2d064327-5dfb-4d57-bf8a-ab02d9add661 response_code = 200 uri = /vpc-routes
28462025-01-13T22:55:01.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {d4c1a21e-1d28-4f7c-933a-2d78de20f95e: {10.151.2.176: {4f33b6ea-4000-437e-a1b6-9210ecc36092}, 10.151.2.175: {4f33b6ea-4000-437e-a1b6-9210ecc36092}}} }
28472025-01-13T22:55:01.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60862 req_id = 2a41b6c6-0fe6-41a9-98d2-f7f702888ed6 response_code = 204 uri = /eip-gateways
28482025-01-13T22:55:01.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60862 req_id = e26c3bb7-4c83-4189-a173-418bd0b573bf response_code = 204 uri = /vpc-routes
28492025-01-13T22:55:01.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45329
28502025-01-13T22:55:01.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45329 req_id = 5e293a3b-14f7-47c7-a126-4d3eba030783 response_code = 200 uri = /v2p
28512025-01-13T22:55:01.236ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:914 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(6563737) }
28522025-01-13T22:55:01.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:45329 req_id = 14993feb-abe2-4c68-85f2-63cb099ebdcd response_code = 204 uri = /v2p
28532025-01-13T22:55:01.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41490
28542025-01-13T22:55:01.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41490 req_id = fa1bcc7c-3a7c-4b50-8037-30c11e6332ec response_code = 200 uri = /vpc-routes
28552025-01-13T22:55:01.317ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
28562025-01-13T22:55:01.317ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b
28572025-01-13T22:55:01.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41490 req_id = 6c0f7bee-cf00-4c42-8924-508d7325f259 response_code = 204 uri = /eip-gateways
28582025-01-13T22:55:01.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41490 req_id = 1bd62d11-89fb-471e-bf9b-c94f60202b5c response_code = 204 uri = /vpc-routes
28592025-01-13T22:55:01.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57372
28602025-01-13T22:55:01.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28612025-01-13T22:55:01.369ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28622025-01-13T22:55:01.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95405 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57372 req_id = b6fd6b4c-ca03-4eb2-b6eb-a86e61aeba79 response_code = 204 uri = /switch-ports
28632025-01-13T22:55:01.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37242
28642025-01-13T22:55:01.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37242 req_id = 396cbb84-7a53-48d6-b567-673b11476777 response_code = 200 uri = /v2p
28652025-01-13T22:55:01.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57372 req_id = 598eabe4-6a9e-4619-84a4-8427f699b004 response_code = 200 uri = /network-bootstore-config
28662025-01-13T22:55:01.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35449
28672025-01-13T22:55:01.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35449 req_id = fba1d032-298f-4f67-afc6-c24d39a75c0b response_code = 200 uri = /v2p
28682025-01-13T22:55:01.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62168
28692025-01-13T22:55:01.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62168 req_id = 2ece8a4c-e5ed-4996-9ec9-481050ae6068 response_code = 200 uri = /vpc-routes
28702025-01-13T22:55:01.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
28712025-01-13T22:55:01.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62168 req_id = 9b820eea-39e7-429f-a74a-7f56bccbb58c response_code = 204 uri = /eip-gateways
28722025-01-13T22:55:01.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62168 req_id = 09c50ad3-f790-49ef-ade0-7e712d6b83c5 response_code = 204 uri = /vpc-routes
28732025-01-13T22:55:02.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54109
28742025-01-13T22:55:02.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54109 req_id = b38b8a2a-aa8e-4033-90f4-9628b7304546 response_code = 200 uri = /vpc-routes
28752025-01-13T22:55:02.539ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = bd8d50a3-f530-430e-8ded-11b6657cae3b values = ExternalIpGatewayMap { mappings: {} }
28762025-01-13T22:55:02.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54109 req_id = dbf057fa-88c3-4f61-a8d1-b3fda2cb77b6 response_code = 204 uri = /eip-gateways
28772025-01-13T22:55:02.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54109 req_id = 87c64c99-1a17-4539-bd92-518f529e82e6 response_code = 204 uri = /vpc-routes