Max level shown:
1 [ Jan 29 07:07:07 Enabled. ]
2 [ Jan 29 07:07:07 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 29 07:07:07 Method "start" exited with status 0. ]
4 [ Jan 29 07:07:07 Rereading configuration. ]
5 [ Jan 29 07:07:07 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-29T07:07:07.707ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-29T07:07:07.707ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-29T07:07:07.762ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-29T07:07:07.762ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-29T07:07:07.877ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-29T07:07:07.886ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-29T07:07:07.894ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-29T07:07:08.500ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-29T07:07:08.640ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-29T07:07:08.640ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-29T07:07:08.640ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-29T07:07:08.640ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-29T07:07:08.640ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-29T07:07:08.640ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-29T07:07:08.643ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-29T07:07:08.643ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-29T07:07:08.643ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-29T07:07:08.643ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-29T07:07:08.643ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-29T07:07:08.644ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-29T07:07:08.644ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-29T07:07:08.644ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-29T07:07:08.644ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-29T07:07:08.656ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-29T07:07:08.656ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool)
322025-01-29T07:07:08.754ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal }
332025-01-29T07:07:09.115ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-29T07:07:09.115ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-29T07:07:09.115ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-29T07:07:09.115ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-29T07:07:09.115ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-29T07:07:09.115ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-29T07:07:09.115ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-29T07:07:09.123ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-29T07:07:09.123ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool)
422025-01-29T07:07:09.210ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal }
432025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-29T07:07:09.571ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
942025-01-29T07:07:09.571ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-29T07:07:09.571ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-29T07:07:09.571ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-29T07:07:09.571ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-29T07:07:09.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1022025-01-29T07:07:09.571ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-29T07:07:09.571ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-29T07:07:09.571ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-29T07:07:09.571ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-29T07:07:09.571ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-29T07:07:09.582ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-29T07:07:09.582ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1290, tv_nsec: 845536817 } time_to_next_cleanup = 599.999920048s
1142025-01-29T07:07:09.582ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-29T07:07:09.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-29T07:07:09.585ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-29T07:07:09.585ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-29T07:07:09.586ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-29T07:07:09.587ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-29T07:07:09.588ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-01-29T07:07:09.588ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-29T07:07:09.588ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-29T07:07:09.588ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-29T07:07:09.588ZINFOSledAgent (RSS): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-29T07:07:09.588ZINFOSledAgent (RSS): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-29T07:07:09.588ZINFOSledAgent (RSS): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-29T07:07:09.588ZINFOSledAgent (RSS): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-29T07:07:09.588ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-01-29T07:07:09.588ZINFOSledAgent (RSS): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-29T07:07:09.588ZINFOSledAgent (RSS): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-29T07:07:09.588ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-01-29T07:07:09.588ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-29T07:07:09.588ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-29T07:07:09.588ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-01-29T07:07:09.589ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-29T07:07:09.589ZINFOSledAgent (bootstore): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-29T07:07:09.589ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-29T07:07:09.589ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-29T07:07:09.589ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 (sled), rack_id: 8ce4b24b-37d8-4e36-9cd6-e54b908b3998, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-29T07:07:09.589ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-29T07:07:09.589ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-29T07:07:09.594ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-29T07:07:09.600ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-29T07:07:09.600ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-29T07:07:09.604ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-29T07:07:09.604ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-29T07:07:09.604ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63992
1482025-01-29T07:07:09.604ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 (sled), rack_id: 8ce4b24b-37d8-4e36-9cd6-e54b908b3998, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-29T07:07:09.604ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-29T07:07:09.604ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-29T07:07:09.605ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-29T07:07:09.605ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-29T07:07:09.605ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-29T07:07:09.605ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-29T07:07:09.620ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-29T07:07:09.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-29T07:07:09.659ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-29T07:07:09.669ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1662025-01-29T07:07:09.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-29T07:07:09.669ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1682025-01-29T07:07:09.669ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-29T07:07:09.672ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 147.738508ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ab2f5230-4937-42e8-aabb-a7adc9a4de6e", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ab2f5230-4937-42e8-aabb-a7adc9a4de6e" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-29T07:07:09.683ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-29T07:07:09.706ZINFOSledAgent: successfully created encrypted zvol: name="oxi_262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-29T07:07:09.706ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-29T07:07:09.711ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1742025-01-29T07:07:09.711ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-29T07:07:09.711ZINFOSledAgent (BackingFs): Ensuring dataset oxi_262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-29T07:07:09.778ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-29T07:07:09.820ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-29T07:07:09.821ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.710395ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3c808ea2-3df4-4004-9ffc-c5332d583f57", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3c808ea2-3df4-4004-9ffc-c5332d583f57" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-29T07:07:09.997ZINFOSledAgent (BackingFs): Mounting oxi_262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1802025-01-29T07:07:10.000ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1812025-01-29T07:07:10.001ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.699592ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9ee758d1-ca1e-4aca-a985-dc14986aa8f4", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9ee758d1-ca1e-4aca-a985-dc14986aa8f4" } file = clients/ddm-admin-client/src/lib.rs:177
1822025-01-29T07:07:10.011ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-29T07:07:10.011ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-29T07:07:10.011ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-29T07:07:10.011ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-29T07:07:10.076ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-29T07:07:10.077ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 213.151354ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b2409b27-daf5-4345-83f8-91a51c954e01", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b2409b27-daf5-4345-83f8-91a51c954e01" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-29T07:07:10.291ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-29T07:07:10.292ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 233.014292ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ff3c6ccf-aa52-4bd2-9168-d5d9e059315e", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ff3c6ccf-aa52-4bd2-9168-d5d9e059315e" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-29T07:07:10.526ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-29T07:07:10.526ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 282.321264ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48f2c781-d622-44d9-aa01-ba2d4fcfb5cf", "content-length": "124", "date": "Wed, 29 Jan 2025 07:07:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48f2c781-d622-44d9-aa01-ba2d4fcfb5cf" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-29T07:07:10.747ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1932025-01-29T07:07:10.753ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:56462 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1942025-01-29T07:07:10.753ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1952025-01-29T07:07:10.753ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:56462 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1962025-01-29T07:07:10.754ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 366.108326ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1972025-01-29T07:07:10.755ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1982025-01-29T07:07:10.755ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
1992025-01-29T07:07:10.755ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2002025-01-29T07:07:10.755ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-01-29T07:07:10.810ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-01-29T07:07:11.121ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 721.270829ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2032025-01-29T07:07:11.843ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.191100615s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2042025-01-29T07:07:13.036ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.275886223s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2052025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2062025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2072025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2082025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2092025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2102025-01-29T07:07:13.330ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2112025-01-29T07:07:13.332ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2122025-01-29T07:07:13.334ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2132025-01-29T07:07:13.334ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='fe88b9ca-c745-44ff-9a6d-877a4d4f926b'/> <propval type="astring" name="rack_id" value='8ce4b24b-37d8-4e36-9cd6-e54b908b3998'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fefe:531e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='8ce4b24b-37d8-4e36-9cd6-e54b908b3998'/> <propval type="astring" name="sled_id" value='6e725a65-3e84-4bcb-8d5c-2bc10a3849f4'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='6e725a65-3e84-4bcb-8d5c-2bc10a3849f4'/> <propval type="astring" name="rack_uuid" value='8ce4b24b-37d8-4e36-9cd6-e54b908b3998'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='6e725a65-3e84-4bcb-8d5c-2bc10a3849f4'/> <propval type="astring" name="rack_uuid" value='8ce4b24b-37d8-4e36-9cd6-e54b908b3998'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-29T07:07:13.334ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-29T07:07:13.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.263086ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-29T07:07:13.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 119.795203ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-29T07:07:14.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 239.94939ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-29T07:07:14.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 366.092457ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-29T07:07:14.384ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.556222163s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2202025-01-29T07:07:14.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 612.901883ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-29T07:07:15.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 969.975207ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-29T07:07:16.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.053555696s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-29T07:07:17.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.082350767s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-29T07:07:18.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.022224997s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2252025-01-29T07:07:18.942ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.656925877s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2262025-01-29T07:07:20.326ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2272025-01-29T07:07:20.327ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2282025-01-29T07:07:20.328ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2292025-01-29T07:07:20.328ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2302025-01-29T07:07:20.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2312025-01-29T07:07:20.328ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-29T07:07:20.328ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-29T07:07:20.329ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2342025-01-29T07:07:20.329ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2352025-01-29T07:07:20.329ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2362025-01-29T07:07:20.500ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:63992
2372025-01-29T07:07:20.500ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-01-29T07:07:20.500ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2392025-01-29T07:07:20.505ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2402025-01-29T07:07:20.505ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2412025-01-29T07:07:20.505ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2422025-01-29T07:07:20.723ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2432025-01-29T07:07:20.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43730
2442025-01-29T07:07:20.752ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-29T07:07:20.752ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-29T07:07:20.752ZINFOSledAgent (ServiceManager): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-29T07:07:20.752ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-29T07:07:20.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43730 req_id = 2194fec5-d63a-432a-be22-2b4d5e7f2353 response_code = 200 uri = /inventory
2492025-01-29T07:07:20.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8419130655975364766 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2502025-01-29T07:07:20.757ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12699699364153789148 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2512025-01-29T07:07:20.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61131
2522025-01-29T07:07:20.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61131 req_id = d59a02ed-8059-4e9a-b118-e96d7c4e32a9 response_code = 200 uri = /sled-role
2532025-01-29T07:07:20.815ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 13e66874-90c9-4857-820a-fdf7d192bc32 (physical_disk), pool_id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4eee1a58-ff44-479a-b1b9-32724d574007 (physical_disk), pool_id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 562870ac-f911-4e21-bd0b-d0bd43919e86 (physical_disk), pool_id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5895712c-3c7d-468a-86c8-f8fd8ccd97c4 (physical_disk), pool_id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 6ce33649-ff3d-4212-a85c-63a15be6acc4 (physical_disk), pool_id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 811fc583-0cf2-41a9-b7b6-dc7fd11f182b (physical_disk), pool_id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 90501ba1-e3e9-42a7-9a29-a6f5a152ea08 (physical_disk), pool_id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 95fce731-a8c3-480f-9fbe-c882355b7eb4 (physical_disk), pool_id: db2b1192-66c6-4615-a94b-80071566494f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e4d0179e-098f-4606-bc77-4549e3606dc9 (physical_disk), pool_id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2542025-01-29T07:07:20.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41385
2552025-01-29T07:07:20.815ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:904 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2562025-01-29T07:07:20.815ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 13e66874-90c9-4857-820a-fdf7d192bc32 (physical_disk), pool_id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 4eee1a58-ff44-479a-b1b9-32724d574007 (physical_disk), pool_id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 562870ac-f911-4e21-bd0b-d0bd43919e86 (physical_disk), pool_id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 5895712c-3c7d-468a-86c8-f8fd8ccd97c4 (physical_disk), pool_id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 6ce33649-ff3d-4212-a85c-63a15be6acc4 (physical_disk), pool_id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 811fc583-0cf2-41a9-b7b6-dc7fd11f182b (physical_disk), pool_id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 90501ba1-e3e9-42a7-9a29-a6f5a152ea08 (physical_disk), pool_id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 95fce731-a8c3-480f-9fbe-c882355b7eb4 (physical_disk), pool_id: db2b1192-66c6-4615-a94b-80071566494f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: e4d0179e-098f-4606-bc77-4549e3606dc9 (physical_disk), pool_id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2572025-01-29T07:07:20.815ZINFOSledAgent (StorageManager): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-01-29T07:07:20.815ZINFOSledAgent (StorageManager): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592025-01-29T07:07:20.815ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2602025-01-29T07:07:20.815ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2612025-01-29T07:07:20.815ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2622025-01-29T07:07:20.815ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2632025-01-29T07:07:20.815ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2642025-01-29T07:07:20.826ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2652025-01-29T07:07:20.826ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = db2b1192-66c6-4615-a94b-80071566494f (zpool)
2662025-01-29T07:07:20.919ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }
2672025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-29T07:07:20.927ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-01-29T07:07:20.958ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-01-29T07:07:20.965ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_db2b1192-66c6-4615-a94b-80071566494f/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-01-29T07:07:21.092ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_db2b1192-66c6-4615-a94b-80071566494f file = sled-storage/src/dataset.rs:388
2772025-01-29T07:07:21.099ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782025-01-29T07:07:21.099ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792025-01-29T07:07:21.099ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802025-01-29T07:07:21.099ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812025-01-29T07:07:21.099ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822025-01-29T07:07:21.109ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832025-01-29T07:07:21.109ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool)
2842025-01-29T07:07:21.206ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }
2852025-01-29T07:07:21.213ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-29T07:07:21.214ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922025-01-29T07:07:21.249ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932025-01-29T07:07:21.258ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/zone file = sled-storage/src/dataset.rs:302
2942025-01-29T07:07:21.331ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
2952025-01-29T07:07:21.400ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd file = sled-storage/src/dataset.rs:388
2962025-01-29T07:07:21.408ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-01-29T07:07:21.408ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-01-29T07:07:21.408ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-01-29T07:07:21.408ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-01-29T07:07:21.408ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-01-29T07:07:21.418ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-01-29T07:07:21.418ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool)
3032025-01-29T07:07:21.511ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }
3042025-01-29T07:07:21.519ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-01-29T07:07:21.519ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-01-29T07:07:21.519ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-01-29T07:07:21.519ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-01-29T07:07:21.519ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-29T07:07:21.520ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-29T07:07:21.520ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-01-29T07:07:21.556ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-01-29T07:07:21.563ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-01-29T07:07:21.701ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe file = sled-storage/src/dataset.rs:388
3142025-01-29T07:07:21.709ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-01-29T07:07:21.709ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-01-29T07:07:21.709ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-01-29T07:07:21.709ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-01-29T07:07:21.709ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-01-29T07:07:21.720ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-01-29T07:07:21.720ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool)
3212025-01-29T07:07:21.812ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }
3222025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-29T07:07:21.821ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-01-29T07:07:21.857ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-01-29T07:07:21.864ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-01-29T07:07:22.001ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13 file = sled-storage/src/dataset.rs:388
3322025-01-29T07:07:22.010ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332025-01-29T07:07:22.010ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342025-01-29T07:07:22.010ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352025-01-29T07:07:22.010ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362025-01-29T07:07:22.010ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372025-01-29T07:07:22.020ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382025-01-29T07:07:22.020ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool)
3392025-01-29T07:07:22.115ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }
3402025-01-29T07:07:22.123ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412025-01-29T07:07:22.123ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422025-01-29T07:07:22.123ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432025-01-29T07:07:22.123ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442025-01-29T07:07:22.123ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-01-29T07:07:22.124ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-29T07:07:22.124ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472025-01-29T07:07:22.157ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482025-01-29T07:07:22.165ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone file = sled-storage/src/dataset.rs:302
3492025-01-29T07:07:22.300ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c196feef-7346-4e4f-b19c-8b3b0708c867 file = sled-storage/src/dataset.rs:388
3502025-01-29T07:07:22.308ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3512025-01-29T07:07:22.308ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3522025-01-29T07:07:22.308ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3532025-01-29T07:07:22.308ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3542025-01-29T07:07:22.308ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3552025-01-29T07:07:22.318ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3562025-01-29T07:07:22.318ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool)
3572025-01-29T07:07:22.410ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }
3582025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3592025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3602025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3612025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3622025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3632025-01-29T07:07:22.418ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-29T07:07:22.419ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3652025-01-29T07:07:22.422ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
3662025-01-29T07:07:22.455ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-01-29T07:07:22.463ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-01-29T07:07:22.600ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2 file = sled-storage/src/dataset.rs:388
3692025-01-29T07:07:22.608ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-01-29T07:07:22.608ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-01-29T07:07:22.608ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-01-29T07:07:22.608ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-01-29T07:07:22.608ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-01-29T07:07:22.617ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-01-29T07:07:22.617ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool)
3762025-01-29T07:07:22.710ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }
3772025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-29T07:07:22.718ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-01-29T07:07:22.756ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-01-29T07:07:22.764ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-01-29T07:07:22.904ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2 file = sled-storage/src/dataset.rs:388
3872025-01-29T07:07:22.913ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882025-01-29T07:07:22.913ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892025-01-29T07:07:22.913ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902025-01-29T07:07:22.913ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912025-01-29T07:07:22.913ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922025-01-29T07:07:22.923ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932025-01-29T07:07:22.923ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 99311bbe-9041-4ee9-9e49-88d0748815df (zpool)
3942025-01-29T07:07:23.030ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }
3952025-01-29T07:07:23.039ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962025-01-29T07:07:23.039ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972025-01-29T07:07:23.039ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982025-01-29T07:07:23.039ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992025-01-29T07:07:23.039ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-01-29T07:07:23.040ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-29T07:07:23.040ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022025-01-29T07:07:23.078ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032025-01-29T07:07:23.086ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone file = sled-storage/src/dataset.rs:302
4042025-01-29T07:07:23.223ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_99311bbe-9041-4ee9-9e49-88d0748815df file = sled-storage/src/dataset.rs:388
4052025-01-29T07:07:23.230ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4062025-01-29T07:07:23.230ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4072025-01-29T07:07:23.230ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4082025-01-29T07:07:23.230ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4092025-01-29T07:07:23.230ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4102025-01-29T07:07:23.240ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4112025-01-29T07:07:23.240ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool)
4122025-01-29T07:07:23.338ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }
4132025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4142025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4152025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4162025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4172025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-29T07:07:23.347ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4202025-01-29T07:07:23.385ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4212025-01-29T07:07:23.393ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone file = sled-storage/src/dataset.rs:302
4222025-01-29T07:07:23.424ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4232025-01-29T07:07:23.532ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_726f1df1-097f-4118-903d-7cffb2ec5c36 file = sled-storage/src/dataset.rs:388
4242025-01-29T07:07:23.540ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-01-29T07:07:23.540ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-01-29T07:07:23.540ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-01-29T07:07:23.540ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ea3e8bb2-6b6c-4f7d-8128-13295772a53f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-01-29T07:07:23.540ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-01-29T07:07:23.540ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-01-29T07:07:23.540ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-29T07:07:23.540ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:908 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4322025-01-29T07:07:23.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-01-29T07:07:23.541ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:934 generation = Generation(2) sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4342025-01-29T07:07:23.541ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:939 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4352025-01-29T07:07:23.541ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:944 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4362025-01-29T07:07:23.541ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4372025-01-29T07:07:23.541ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:950 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4382025-01-29T07:07:23.541ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-01-29T07:07:23.541ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:955 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4402025-01-29T07:07:23.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2725739 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41385 req_id = e7baf501-049a-4791-a00c-d0afa7604130 response_code = 200 uri = /omicron-physical-disks
4412025-01-29T07:07:23.572ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {01543018-8bb8-403c-8055-7c4a38a4fbc7 (dataset): DatasetConfig { id: 01543018-8bb8-403c-8055-7c4a38a4fbc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02875f0b-04c2-4972-b95d-c38ddb3f0cc4 (dataset): DatasetConfig { id: 02875f0b-04c2-4972-b95d-c38ddb3f0cc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 084389c2-4955-4554-8037-63e8c380d9a8 (dataset): DatasetConfig { id: 084389c2-4955-4554-8037-63e8c380d9a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1039e5cb-b8a6-43c0-926f-4cf06d09a1c8 (dataset): DatasetConfig { id: 1039e5cb-b8a6-43c0-926f-4cf06d09a1c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 133263c0-d4bd-4431-9a6d-f7c4053adc4a (dataset): DatasetConfig { id: 133263c0-d4bd-4431-9a6d-f7c4053adc4a (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f532c76-5eeb-41a9-8db4-b66f1baa1e51 (dataset): DatasetConfig { id: 1f532c76-5eeb-41a9-8db4-b66f1baa1e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2109c9b2-38ae-4a04-b71f-f2f4e9a97323 (dataset): DatasetConfig { id: 2109c9b2-38ae-4a04-b71f-f2f4e9a97323 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2130a096-f38e-46c2-b514-ce3ec8e93cce (dataset): DatasetConfig { id: 2130a096-f38e-46c2-b514-ce3ec8e93cce (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 256926e1-8e7d-45b7-8374-d590b83ad9a7 (dataset): DatasetConfig { id: 256926e1-8e7d-45b7-8374-d590b83ad9a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 262b9326-d99b-4aa0-88ae-bfc44fe8e09f (dataset): DatasetConfig { id: 262b9326-d99b-4aa0-88ae-bfc44fe8e09f (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27556d9f-b65a-4fd4-a88f-e0ef732e1bdc (dataset): DatasetConfig { id: 27556d9f-b65a-4fd4-a88f-e0ef732e1bdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27c506fa-a911-475b-9adf-e11d7c17653e (dataset): DatasetConfig { id: 27c506fa-a911-475b-9adf-e11d7c17653e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dd2c74e-d342-4ec7-b353-3b96dfe02986 (dataset): DatasetConfig { id: 2dd2c74e-d342-4ec7-b353-3b96dfe02986 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30820a7a-aa22-44c2-bd9e-666e35694305 (dataset): DatasetConfig { id: 30820a7a-aa22-44c2-bd9e-666e35694305 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30e8de91-4af3-40d5-a1be-9a185900998c (dataset): DatasetConfig { id: 30e8de91-4af3-40d5-a1be-9a185900998c (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3664ff7e-1699-4bd7-8672-23a8328e5849 (dataset): DatasetConfig { id: 3664ff7e-1699-4bd7-8672-23a8328e5849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 394300d9-b95a-4ac1-a2a8-d19d3d917ccd (dataset): DatasetConfig { id: 394300d9-b95a-4ac1-a2a8-d19d3d917ccd (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39922c22-9ac4-4447-bd1e-d276e574b33c (dataset): DatasetConfig { id: 39922c22-9ac4-4447-bd1e-d276e574b33c (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 399f11cf-05da-47d8-8336-d72f90df2893 (dataset): DatasetConfig { id: 399f11cf-05da-47d8-8336-d72f90df2893 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f7ac5ed-a883-4774-b3ec-1340adb2e8d1 (dataset): DatasetConfig { id: 3f7ac5ed-a883-4774-b3ec-1340adb2e8d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4269f27f-9c48-4d66-806a-4c739d100dd4 (dataset): DatasetConfig { id: 4269f27f-9c48-4d66-806a-4c739d100dd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45aaa1a2-9b08-47a0-b35a-8e814eb71456 (dataset): DatasetConfig { id: 45aaa1a2-9b08-47a0-b35a-8e814eb71456 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49a65245-5165-4586-9cf2-f4505342555b (dataset): DatasetConfig { id: 49a65245-5165-4586-9cf2-f4505342555b (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50fd2c48-1ba0-4540-8a5e-7653de90ceaf (dataset): DatasetConfig { id: 50fd2c48-1ba0-4540-8a5e-7653de90ceaf (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 544858ab-39fc-4820-80d5-c5cfbb9cc897 (dataset): DatasetConfig { id: 544858ab-39fc-4820-80d5-c5cfbb9cc897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a071161-56bf-4850-a2d6-acb14fcd0494 (dataset): DatasetConfig { id: 5a071161-56bf-4850-a2d6-acb14fcd0494 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f262951-b219-4064-999b-2dfb31ecf287 (dataset): DatasetConfig { id: 5f262951-b219-4064-999b-2dfb31ecf287 (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6003a85a-adb9-4049-b27d-3c3c04dcd81d (dataset): DatasetConfig { id: 6003a85a-adb9-4049-b27d-3c3c04dcd81d (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62f72085-b653-4d00-857d-184bf8ad3e6a (dataset): DatasetConfig { id: 62f72085-b653-4d00-857d-184bf8ad3e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 656df8a6-3201-4b77-b050-91355c5d96c4 (dataset): DatasetConfig { id: 656df8a6-3201-4b77-b050-91355c5d96c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70c9b349-0918-4864-a0e3-aa224f12a0ea (dataset): DatasetConfig { id: 70c9b349-0918-4864-a0e3-aa224f12a0ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75dd8218-795d-4bb2-8c95-472999b4e69d (dataset): DatasetConfig { id: 75dd8218-795d-4bb2-8c95-472999b4e69d (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ac054e3-53b2-4750-96e4-7a69a347df87 (dataset): DatasetConfig { id: 7ac054e3-53b2-4750-96e4-7a69a347df87 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7de087cb-6459-4e06-a8c6-68ceba1bbf90 (dataset): DatasetConfig { id: 7de087cb-6459-4e06-a8c6-68ceba1bbf90 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84c054bf-6e04-43c7-80dc-726fd41b1d2f (dataset): DatasetConfig { id: 84c054bf-6e04-43c7-80dc-726fd41b1d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84cf6527-df97-4f76-aa50-3948686987df (dataset): DatasetConfig { id: 84cf6527-df97-4f76-aa50-3948686987df (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86e08686-3646-4511-9dba-9a4bb592b465 (dataset): DatasetConfig { id: 86e08686-3646-4511-9dba-9a4bb592b465 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88178f95-d07b-4405-b3d3-41248d6884e3 (dataset): DatasetConfig { id: 88178f95-d07b-4405-b3d3-41248d6884e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 952c7df0-9c54-4f52-abd9-a1f4e88a5e27 (dataset): DatasetConfig { id: 952c7df0-9c54-4f52-abd9-a1f4e88a5e27 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9725d222-96c5-4a7d-9258-c44e9033f716 (dataset): DatasetConfig { id: 9725d222-96c5-4a7d-9258-c44e9033f716 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a05464cd-4608-486d-9e73-e632f19c5bc5 (dataset): DatasetConfig { id: a05464cd-4608-486d-9e73-e632f19c5bc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5737a6a-2f5a-4158-acd1-943f008ac4ab (dataset): DatasetConfig { id: a5737a6a-2f5a-4158-acd1-943f008ac4ab (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a77a16b0-91fd-4f1c-825f-24e393113b9f (dataset): DatasetConfig { id: a77a16b0-91fd-4f1c-825f-24e393113b9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8e5b62b-dac0-4d14-b723-fa814488c2ea (dataset): DatasetConfig { id: a8e5b62b-dac0-4d14-b723-fa814488c2ea (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1084126-1473-4008-9b74-474ebac00004 (dataset): DatasetConfig { id: b1084126-1473-4008-9b74-474ebac00004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1f446c9-ba8d-48ff-8297-435cb42ce9e7 (dataset): DatasetConfig { id: b1f446c9-ba8d-48ff-8297-435cb42ce9e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1f75a8e-9679-4dca-9990-ba32f12b088c (dataset): DatasetConfig { id: b1f75a8e-9679-4dca-9990-ba32f12b088c (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b417d322-7141-4c15-90f1-3defc33a0522 (dataset): DatasetConfig { id: b417d322-7141-4c15-90f1-3defc33a0522 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5ca8f23-dd21-4642-a68f-dcab78faea68 (dataset): DatasetConfig { id: b5ca8f23-dd21-4642-a68f-dcab78faea68 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b881361a-8aaa-4b3c-81b5-065ee31fb301 (dataset): DatasetConfig { id: b881361a-8aaa-4b3c-81b5-065ee31fb301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bda5cb2a-c90a-47ea-ab93-f934d8144915 (dataset): DatasetConfig { id: bda5cb2a-c90a-47ea-ab93-f934d8144915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c007e44a-30e6-45fc-be34-bee7c5dfda8e (dataset): DatasetConfig { id: c007e44a-30e6-45fc-be34-bee7c5dfda8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c39ca2f4-51bb-40b6-9b52-a0b1d07ee554 (dataset): DatasetConfig { id: c39ca2f4-51bb-40b6-9b52-a0b1d07ee554 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ba09c1-4078-4030-bf80-aee87f5a61e8 (dataset): DatasetConfig { id: c3ba09c1-4078-4030-bf80-aee87f5a61e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d76c5ed3-1e39-4c3d-8a19-c32c9165fbd2 (dataset): DatasetConfig { id: d76c5ed3-1e39-4c3d-8a19-c32c9165fbd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d98f1300-7f03-40d5-b453-25eb59af7932 (dataset): DatasetConfig { id: d98f1300-7f03-40d5-b453-25eb59af7932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc110ad6-0e19-4cfa-9ba7-2be74f9178af (dataset): DatasetConfig { id: dc110ad6-0e19-4cfa-9ba7-2be74f9178af (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df04e641-314d-4697-8a9f-a5b47e02d5d4 (dataset): DatasetConfig { id: df04e641-314d-4697-8a9f-a5b47e02d5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0def85a-9969-459e-a150-467625bc4698 (dataset): DatasetConfig { id: e0def85a-9969-459e-a150-467625bc4698 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ef60584f-6043-412d-8758-45a09e606085" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e631c5db-b8ae-4b07-b7db-45aca6f8fe13 (dataset): DatasetConfig { id: e631c5db-b8ae-4b07-b7db-45aca6f8fe13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb0b4a49-a4f5-43d3-9437-7982b00962b7 (dataset): DatasetConfig { id: eb0b4a49-a4f5-43d3-9437-7982b00962b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec67d39e-b38a-4cf6-853c-0471bc5038b7 (dataset): DatasetConfig { id: ec67d39e-b38a-4cf6-853c-0471bc5038b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eda9728e-ecb4-4767-a70c-b01d9ef57d04 (dataset): DatasetConfig { id: eda9728e-ecb4-4767-a70c-b01d9ef57d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f357a1c0-067b-49a0-ad26-04fffd4d1dad (dataset): DatasetConfig { id: f357a1c0-067b-49a0-ad26-04fffd4d1dad (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc661cca-cc0d-4258-9973-ed0564776f5c (dataset): DatasetConfig { id: fc661cca-cc0d-4258-9973-ed0564776f5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcfe3b67-f0fc-4328-a9ab-bafbf0077df0 (dataset): DatasetConfig { id: fcfe3b67-f0fc-4328-a9ab-bafbf0077df0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-01-29T07:07:23.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51489
4432025-01-29T07:07:23.573ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:870 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
4442025-01-29T07:07:23.573ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {01543018-8bb8-403c-8055-7c4a38a4fbc7 (dataset): DatasetConfig { id: 01543018-8bb8-403c-8055-7c4a38a4fbc7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 02875f0b-04c2-4972-b95d-c38ddb3f0cc4 (dataset): DatasetConfig { id: 02875f0b-04c2-4972-b95d-c38ddb3f0cc4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 084389c2-4955-4554-8037-63e8c380d9a8 (dataset): DatasetConfig { id: 084389c2-4955-4554-8037-63e8c380d9a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1039e5cb-b8a6-43c0-926f-4cf06d09a1c8 (dataset): DatasetConfig { id: 1039e5cb-b8a6-43c0-926f-4cf06d09a1c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 133263c0-d4bd-4431-9a6d-f7c4053adc4a (dataset): DatasetConfig { id: 133263c0-d4bd-4431-9a6d-f7c4053adc4a (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f532c76-5eeb-41a9-8db4-b66f1baa1e51 (dataset): DatasetConfig { id: 1f532c76-5eeb-41a9-8db4-b66f1baa1e51 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2109c9b2-38ae-4a04-b71f-f2f4e9a97323 (dataset): DatasetConfig { id: 2109c9b2-38ae-4a04-b71f-f2f4e9a97323 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2130a096-f38e-46c2-b514-ce3ec8e93cce (dataset): DatasetConfig { id: 2130a096-f38e-46c2-b514-ce3ec8e93cce (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 256926e1-8e7d-45b7-8374-d590b83ad9a7 (dataset): DatasetConfig { id: 256926e1-8e7d-45b7-8374-d590b83ad9a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 262b9326-d99b-4aa0-88ae-bfc44fe8e09f (dataset): DatasetConfig { id: 262b9326-d99b-4aa0-88ae-bfc44fe8e09f (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27556d9f-b65a-4fd4-a88f-e0ef732e1bdc (dataset): DatasetConfig { id: 27556d9f-b65a-4fd4-a88f-e0ef732e1bdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27c506fa-a911-475b-9adf-e11d7c17653e (dataset): DatasetConfig { id: 27c506fa-a911-475b-9adf-e11d7c17653e (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2dd2c74e-d342-4ec7-b353-3b96dfe02986 (dataset): DatasetConfig { id: 2dd2c74e-d342-4ec7-b353-3b96dfe02986 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30820a7a-aa22-44c2-bd9e-666e35694305 (dataset): DatasetConfig { id: 30820a7a-aa22-44c2-bd9e-666e35694305 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30e8de91-4af3-40d5-a1be-9a185900998c (dataset): DatasetConfig { id: 30e8de91-4af3-40d5-a1be-9a185900998c (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3664ff7e-1699-4bd7-8672-23a8328e5849 (dataset): DatasetConfig { id: 3664ff7e-1699-4bd7-8672-23a8328e5849 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 394300d9-b95a-4ac1-a2a8-d19d3d917ccd (dataset): DatasetConfig { id: 394300d9-b95a-4ac1-a2a8-d19d3d917ccd (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 39922c22-9ac4-4447-bd1e-d276e574b33c (dataset): DatasetConfig { id: 39922c22-9ac4-4447-bd1e-d276e574b33c (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 399f11cf-05da-47d8-8336-d72f90df2893 (dataset): DatasetConfig { id: 399f11cf-05da-47d8-8336-d72f90df2893 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f7ac5ed-a883-4774-b3ec-1340adb2e8d1 (dataset): DatasetConfig { id: 3f7ac5ed-a883-4774-b3ec-1340adb2e8d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4269f27f-9c48-4d66-806a-4c739d100dd4 (dataset): DatasetConfig { id: 4269f27f-9c48-4d66-806a-4c739d100dd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45aaa1a2-9b08-47a0-b35a-8e814eb71456 (dataset): DatasetConfig { id: 45aaa1a2-9b08-47a0-b35a-8e814eb71456 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49a65245-5165-4586-9cf2-f4505342555b (dataset): DatasetConfig { id: 49a65245-5165-4586-9cf2-f4505342555b (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50fd2c48-1ba0-4540-8a5e-7653de90ceaf (dataset): DatasetConfig { id: 50fd2c48-1ba0-4540-8a5e-7653de90ceaf (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 544858ab-39fc-4820-80d5-c5cfbb9cc897 (dataset): DatasetConfig { id: 544858ab-39fc-4820-80d5-c5cfbb9cc897 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5a071161-56bf-4850-a2d6-acb14fcd0494 (dataset): DatasetConfig { id: 5a071161-56bf-4850-a2d6-acb14fcd0494 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f262951-b219-4064-999b-2dfb31ecf287 (dataset): DatasetConfig { id: 5f262951-b219-4064-999b-2dfb31ecf287 (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6003a85a-adb9-4049-b27d-3c3c04dcd81d (dataset): DatasetConfig { id: 6003a85a-adb9-4049-b27d-3c3c04dcd81d (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 62f72085-b653-4d00-857d-184bf8ad3e6a (dataset): DatasetConfig { id: 62f72085-b653-4d00-857d-184bf8ad3e6a (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 656df8a6-3201-4b77-b050-91355c5d96c4 (dataset): DatasetConfig { id: 656df8a6-3201-4b77-b050-91355c5d96c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70c9b349-0918-4864-a0e3-aa224f12a0ea (dataset): DatasetConfig { id: 70c9b349-0918-4864-a0e3-aa224f12a0ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75dd8218-795d-4bb2-8c95-472999b4e69d (dataset): DatasetConfig { id: 75dd8218-795d-4bb2-8c95-472999b4e69d (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ac054e3-53b2-4750-96e4-7a69a347df87 (dataset): DatasetConfig { id: 7ac054e3-53b2-4750-96e4-7a69a347df87 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7de087cb-6459-4e06-a8c6-68ceba1bbf90 (dataset): DatasetConfig { id: 7de087cb-6459-4e06-a8c6-68ceba1bbf90 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84c054bf-6e04-43c7-80dc-726fd41b1d2f (dataset): DatasetConfig { id: 84c054bf-6e04-43c7-80dc-726fd41b1d2f (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 84cf6527-df97-4f76-aa50-3948686987df (dataset): DatasetConfig { id: 84cf6527-df97-4f76-aa50-3948686987df (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86e08686-3646-4511-9dba-9a4bb592b465 (dataset): DatasetConfig { id: 86e08686-3646-4511-9dba-9a4bb592b465 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88178f95-d07b-4405-b3d3-41248d6884e3 (dataset): DatasetConfig { id: 88178f95-d07b-4405-b3d3-41248d6884e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 952c7df0-9c54-4f52-abd9-a1f4e88a5e27 (dataset): DatasetConfig { id: 952c7df0-9c54-4f52-abd9-a1f4e88a5e27 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9725d222-96c5-4a7d-9258-c44e9033f716 (dataset): DatasetConfig { id: 9725d222-96c5-4a7d-9258-c44e9033f716 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a05464cd-4608-486d-9e73-e632f19c5bc5 (dataset): DatasetConfig { id: a05464cd-4608-486d-9e73-e632f19c5bc5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5737a6a-2f5a-4158-acd1-943f008ac4ab (dataset): DatasetConfig { id: a5737a6a-2f5a-4158-acd1-943f008ac4ab (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a77a16b0-91fd-4f1c-825f-24e393113b9f (dataset): DatasetConfig { id: a77a16b0-91fd-4f1c-825f-24e393113b9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8e5b62b-dac0-4d14-b723-fa814488c2ea (dataset): DatasetConfig { id: a8e5b62b-dac0-4d14-b723-fa814488c2ea (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1084126-1473-4008-9b74-474ebac00004 (dataset): DatasetConfig { id: b1084126-1473-4008-9b74-474ebac00004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1f446c9-ba8d-48ff-8297-435cb42ce9e7 (dataset): DatasetConfig { id: b1f446c9-ba8d-48ff-8297-435cb42ce9e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1f75a8e-9679-4dca-9990-ba32f12b088c (dataset): DatasetConfig { id: b1f75a8e-9679-4dca-9990-ba32f12b088c (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b417d322-7141-4c15-90f1-3defc33a0522 (dataset): DatasetConfig { id: b417d322-7141-4c15-90f1-3defc33a0522 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5ca8f23-dd21-4642-a68f-dcab78faea68 (dataset): DatasetConfig { id: b5ca8f23-dd21-4642-a68f-dcab78faea68 (dataset), name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b881361a-8aaa-4b3c-81b5-065ee31fb301 (dataset): DatasetConfig { id: b881361a-8aaa-4b3c-81b5-065ee31fb301 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bda5cb2a-c90a-47ea-ab93-f934d8144915 (dataset): DatasetConfig { id: bda5cb2a-c90a-47ea-ab93-f934d8144915 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c007e44a-30e6-45fc-be34-bee7c5dfda8e (dataset): DatasetConfig { id: c007e44a-30e6-45fc-be34-bee7c5dfda8e (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c39ca2f4-51bb-40b6-9b52-a0b1d07ee554 (dataset): DatasetConfig { id: c39ca2f4-51bb-40b6-9b52-a0b1d07ee554 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3ba09c1-4078-4030-bf80-aee87f5a61e8 (dataset): DatasetConfig { id: c3ba09c1-4078-4030-bf80-aee87f5a61e8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d76c5ed3-1e39-4c3d-8a19-c32c9165fbd2 (dataset): DatasetConfig { id: d76c5ed3-1e39-4c3d-8a19-c32c9165fbd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d98f1300-7f03-40d5-b453-25eb59af7932 (dataset): DatasetConfig { id: d98f1300-7f03-40d5-b453-25eb59af7932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc110ad6-0e19-4cfa-9ba7-2be74f9178af (dataset): DatasetConfig { id: dc110ad6-0e19-4cfa-9ba7-2be74f9178af (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df04e641-314d-4697-8a9f-a5b47e02d5d4 (dataset): DatasetConfig { id: df04e641-314d-4697-8a9f-a5b47e02d5d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e0def85a-9969-459e-a150-467625bc4698 (dataset): DatasetConfig { id: e0def85a-9969-459e-a150-467625bc4698 (dataset), name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ef60584f-6043-412d-8758-45a09e606085" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e631c5db-b8ae-4b07-b7db-45aca6f8fe13 (dataset): DatasetConfig { id: e631c5db-b8ae-4b07-b7db-45aca6f8fe13 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb0b4a49-a4f5-43d3-9437-7982b00962b7 (dataset): DatasetConfig { id: eb0b4a49-a4f5-43d3-9437-7982b00962b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec67d39e-b38a-4cf6-853c-0471bc5038b7 (dataset): DatasetConfig { id: ec67d39e-b38a-4cf6-853c-0471bc5038b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eda9728e-ecb4-4767-a70c-b01d9ef57d04 (dataset): DatasetConfig { id: eda9728e-ecb4-4767-a70c-b01d9ef57d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f357a1c0-067b-49a0-ad26-04fffd4d1dad (dataset): DatasetConfig { id: f357a1c0-067b-49a0-ad26-04fffd4d1dad (dataset), name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc661cca-cc0d-4258-9973-ed0564776f5c (dataset): DatasetConfig { id: fc661cca-cc0d-4258-9973-ed0564776f5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fcfe3b67-f0fc-4328-a9ab-bafbf0077df0 (dataset): DatasetConfig { id: fcfe3b67-f0fc-4328-a9ab-bafbf0077df0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-01-29T07:07:23.573ZINFOSledAgent (StorageManager): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-29T07:07:23.573ZINFOSledAgent (StorageManager): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-29T07:07:23.573ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-01-29T07:07:23.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-01-29T07:07:23.588ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-01-29T07:07:23.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102" } file = sled-storage/src/manager.rs:1431
4512025-01-29T07:07:23.643ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-01-29T07:07:23.643ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-01-29T07:07:23.643ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97" } file = sled-storage/src/manager.rs:1431
4542025-01-29T07:07:23.719ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-29T07:07:23.719ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562025-01-29T07:07:23.719ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb" } file = sled-storage/src/manager.rs:1431
4572025-01-29T07:07:23.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-29T07:07:23.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4592025-01-29T07:07:23.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd" } file = sled-storage/src/manager.rs:1431
4602025-01-29T07:07:23.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-29T07:07:23.829ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4622025-01-29T07:07:23.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a" } file = sled-storage/src/manager.rs:1431
4632025-01-29T07:07:23.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-29T07:07:23.887ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4652025-01-29T07:07:23.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/debug"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/debug" } file = sled-storage/src/manager.rs:1431
4662025-01-29T07:07:23.913ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-29T07:07:23.913ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-01-29T07:07:23.913ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb" } file = sled-storage/src/manager.rs:1431
4692025-01-29T07:07:23.970ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-29T07:07:23.970ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-29T07:07:23.970ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1" } file = sled-storage/src/manager.rs:1431
4722025-01-29T07:07:24.025ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-01-29T07:07:24.025ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4742025-01-29T07:07:24.025ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db2b1192-66c6-4615-a94b-80071566494f/crypt/debug"), full_name: "oxp_db2b1192-66c6-4615-a94b-80071566494f/crypt/debug" } file = sled-storage/src/manager.rs:1431
4752025-01-29T07:07:24.052ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-01-29T07:07:24.052ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4772025-01-29T07:07:24.052ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88" } file = sled-storage/src/manager.rs:1431
4782025-01-29T07:07:24.107ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-29T07:07:24.107ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-01-29T07:07:24.107ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4812025-01-29T07:07:24.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-29T07:07:24.155ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-29T07:07:24.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone/oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone/oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098" } file = sled-storage/src/manager.rs:1431
4842025-01-29T07:07:24.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-29T07:07:24.212ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-29T07:07:24.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067" } file = sled-storage/src/manager.rs:1431
4872025-01-29T07:07:24.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-29T07:07:24.268ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-29T07:07:24.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b" } file = sled-storage/src/manager.rs:1431
4902025-01-29T07:07:24.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-29T07:07:24.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-01-29T07:07:24.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866" } file = sled-storage/src/manager.rs:1431
4932025-01-29T07:07:24.380ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-29T07:07:24.380ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4952025-01-29T07:07:24.380ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone" } file = sled-storage/src/manager.rs:1431
4962025-01-29T07:07:24.407ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-29T07:07:24.407ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-01-29T07:07:24.407ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crucible" } file = sled-storage/src/manager.rs:1431
4992025-01-29T07:07:24.427ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
5002025-01-29T07:07:24.454ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-29T07:07:24.454ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022025-01-29T07:07:24.454ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/zone"), full_name: "oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/zone" } file = sled-storage/src/manager.rs:1431
5032025-01-29T07:07:24.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-29T07:07:24.482ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-29T07:07:24.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible" } file = sled-storage/src/manager.rs:1431
5062025-01-29T07:07:24.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-29T07:07:24.527ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-29T07:07:24.527ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone/oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone/oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc" } file = sled-storage/src/manager.rs:1431
5092025-01-29T07:07:24.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-29T07:07:24.584ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-29T07:07:24.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5122025-01-29T07:07:24.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-29T07:07:24.631ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-01-29T07:07:24.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5152025-01-29T07:07:24.679ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-29T07:07:24.679ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-01-29T07:07:24.679ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/debug"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/debug" } file = sled-storage/src/manager.rs:1431
5182025-01-29T07:07:24.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-29T07:07:24.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-29T07:07:24.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/zone/oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb"), full_name: "oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/zone/oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb" } file = sled-storage/src/manager.rs:1431
5212025-01-29T07:07:24.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-29T07:07:24.768ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5232025-01-29T07:07:24.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone" } file = sled-storage/src/manager.rs:1431
5242025-01-29T07:07:24.796ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-29T07:07:24.796ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-01-29T07:07:24.796ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5272025-01-29T07:07:24.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-29T07:07:24.843ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5292025-01-29T07:07:24.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/debug"), full_name: "oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/debug" } file = sled-storage/src/manager.rs:1431
5302025-01-29T07:07:24.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-01-29T07:07:24.872ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5322025-01-29T07:07:24.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5332025-01-29T07:07:24.899ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342025-01-29T07:07:24.899ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352025-01-29T07:07:24.899ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531" } file = sled-storage/src/manager.rs:1431
5362025-01-29T07:07:24.963ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372025-01-29T07:07:24.963ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5382025-01-29T07:07:24.963ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5392025-01-29T07:07:24.992ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402025-01-29T07:07:24.992ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5412025-01-29T07:07:24.992ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42" } file = sled-storage/src/manager.rs:1431
5422025-01-29T07:07:25.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-29T07:07:25.049ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442025-01-29T07:07:25.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db2b1192-66c6-4615-a94b-80071566494f/crypt/zone/oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6"), full_name: "oxp_db2b1192-66c6-4615-a94b-80071566494f/crypt/zone/oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6" } file = sled-storage/src/manager.rs:1431
5452025-01-29T07:07:25.111ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-29T07:07:25.111ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5472025-01-29T07:07:25.111ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crucible" } file = sled-storage/src/manager.rs:1431
5482025-01-29T07:07:25.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-29T07:07:25.159ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502025-01-29T07:07:25.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crucible" } file = sled-storage/src/manager.rs:1431
5512025-01-29T07:07:25.208ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-29T07:07:25.208ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532025-01-29T07:07:25.208ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5542025-01-29T07:07:25.256ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-29T07:07:25.256ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5562025-01-29T07:07:25.256ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone" } file = sled-storage/src/manager.rs:1431
5572025-01-29T07:07:25.284ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-29T07:07:25.284ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5592025-01-29T07:07:25.284ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/debug"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5602025-01-29T07:07:25.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-29T07:07:25.314ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5622025-01-29T07:07:25.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/debug"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/debug" } file = sled-storage/src/manager.rs:1431
5632025-01-29T07:07:25.344ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-01-29T07:07:25.344ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-01-29T07:07:25.344ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5662025-01-29T07:07:25.393ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-29T07:07:25.393ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5682025-01-29T07:07:25.393ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/debug"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/debug" } file = sled-storage/src/manager.rs:1431
5692025-01-29T07:07:25.422ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-29T07:07:25.422ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712025-01-29T07:07:25.422ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f" } file = sled-storage/src/manager.rs:1431
5722025-01-29T07:07:25.432ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
5732025-01-29T07:07:25.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-29T07:07:25.482ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5752025-01-29T07:07:25.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/debug"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/debug" } file = sled-storage/src/manager.rs:1431
5762025-01-29T07:07:25.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-29T07:07:25.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-29T07:07:25.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32" } file = sled-storage/src/manager.rs:1431
5792025-01-29T07:07:25.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-29T07:07:25.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-29T07:07:25.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15" } file = sled-storage/src/manager.rs:1431
5822025-01-29T07:07:25.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-29T07:07:25.631ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-01-29T07:07:25.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8" } file = sled-storage/src/manager.rs:1431
5852025-01-29T07:07:25.690ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-29T07:07:25.690ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872025-01-29T07:07:25.690ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5882025-01-29T07:07:25.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-29T07:07:25.741ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-01-29T07:07:25.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/zone/oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d"), full_name: "oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/zone/oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d" } file = sled-storage/src/manager.rs:1431
5912025-01-29T07:07:25.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-29T07:07:25.800ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5932025-01-29T07:07:25.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/db2b1192-66c6-4615-a94b-80071566494f/crypt/zone"), full_name: "oxp_db2b1192-66c6-4615-a94b-80071566494f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5942025-01-29T07:07:25.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-29T07:07:25.830ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-29T07:07:25.830ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_db2b1192-66c6-4615-a94b-80071566494f/crucible" } file = sled-storage/src/manager.rs:1431
5972025-01-29T07:07:25.877ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-01-29T07:07:25.877ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992025-01-29T07:07:25.877ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769" } file = sled-storage/src/manager.rs:1431
6002025-01-29T07:07:25.938ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-01-29T07:07:25.938ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022025-01-29T07:07:25.938ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6032025-01-29T07:07:25.991ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-29T07:07:25.991ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052025-01-29T07:07:25.991ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/debug"), full_name: "oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/debug" } file = sled-storage/src/manager.rs:1431
6062025-01-29T07:07:26.020ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-29T07:07:26.020ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-29T07:07:26.020ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6092025-01-29T07:07:26.072ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-29T07:07:26.072ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-01-29T07:07:26.072ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crucible" } file = sled-storage/src/manager.rs:1431
6122025-01-29T07:07:26.120ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-29T07:07:26.120ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-01-29T07:07:26.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6152025-01-29T07:07:26.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-29T07:07:26.170ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-29T07:07:26.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crucible" } file = sled-storage/src/manager.rs:1431
6182025-01-29T07:07:26.218ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-29T07:07:26.218ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-29T07:07:26.218ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/zone/oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d" } file = sled-storage/src/manager.rs:1431
6212025-01-29T07:07:26.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-29T07:07:26.276ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-29T07:07:26.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crucible" } file = sled-storage/src/manager.rs:1431
6242025-01-29T07:07:26.323ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-29T07:07:26.323ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-01-29T07:07:26.323ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_crucible_ef60584f-6043-412d-8758-45a09e606085"), full_name: "oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/zone/oxz_crucible_ef60584f-6043-412d-8758-45a09e606085" } file = sled-storage/src/manager.rs:1431
6272025-01-29T07:07:26.383ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-29T07:07:26.383ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-01-29T07:07:26.383ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crucible" } file = sled-storage/src/manager.rs:1431
6302025-01-29T07:07:26.431ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-29T07:07:26.431ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322025-01-29T07:07:26.431ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone/oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59" } file = sled-storage/src/manager.rs:1431
6332025-01-29T07:07:26.435ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
6342025-01-29T07:07:26.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-29T07:07:26.494ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-29T07:07:26.494ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a"), full_name: "oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/zone/oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a" } file = sled-storage/src/manager.rs:1431
6372025-01-29T07:07:26.556ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-29T07:07:26.556ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6392025-01-29T07:07:26.556ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone"), full_name: "oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crypt/zone" } file = sled-storage/src/manager.rs:1431
6402025-01-29T07:07:26.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-29T07:07:26.586ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-29T07:07:26.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6432025-01-29T07:07:26.635ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-29T07:07:26.635ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6452025-01-29T07:07:26.635ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/zone"), full_name: "oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/zone" } file = sled-storage/src/manager.rs:1431
6462025-01-29T07:07:26.664ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-29T07:07:26.664ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-01-29T07:07:26.664ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669"), full_name: "oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/zone/oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669" } file = sled-storage/src/manager.rs:1431
6492025-01-29T07:07:26.724ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-01-29T07:07:26.724ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-29T07:07:26.725ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:872 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
6522025-01-29T07:07:26.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3152540 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51489 req_id = bee6216e-ceee-4608-9809-e924f078cbe3 response_code = 200 uri = /datasets
6532025-01-29T07:07:26.757ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 38eceebd-5174-4206-b76c-bdfe4dc2356b (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9ef8078f-3af0-4c43-bf26-bb6c97ef3669 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e9debc14-429e-4cb4-936e-4e86e790ae15 (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542025-01-29T07:07:26.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65471
6552025-01-29T07:07:26.757ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6562025-01-29T07:07:26.757ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572025-01-29T07:07:26.766ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-01-29T07:07:26.766ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-01-29T07:07:26.774ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-29T07:07:26.774ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-29T07:07:26.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-01-29T07:07:26.783ZINFOSledAgent (ServiceManager): No ledger in /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:188
6632025-01-29T07:07:26.783ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-29T07:07:26.783ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-01-29T07:07:26.826ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-29T07:07:26.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-29T07:07:26.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-29T07:07:26.880ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b file = illumos-utils/src/zone.rs:325
6692025-01-29T07:07:26.884ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669 file = illumos-utils/src/zone.rs:325
6702025-01-29T07:07:26.888ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15 file = illumos-utils/src/zone.rs:325
6712025-01-29T07:07:26.900ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b file = illumos-utils/src/zone.rs:363
6722025-01-29T07:07:26.905ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669 file = illumos-utils/src/zone.rs:363
6732025-01-29T07:07:26.909ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15 file = illumos-utils/src/zone.rs:363
6742025-01-29T07:07:27.438ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/probe_manager.rs:231 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
6752025-01-29T07:07:28.515ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762025-01-29T07:07:28.515ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6772025-01-29T07:07:28.515ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
6782025-01-29T07:07:29.000ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792025-01-29T07:07:29.000ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802025-01-29T07:07:29.479ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-29T07:07:29.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 60.769924ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
6822025-01-29T07:07:29.486ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
6832025-01-29T07:07:29.490ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6842025-01-29T07:07:29.490ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
6852025-01-29T07:07:29.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 73.951749ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
6862025-01-29T07:07:29.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 50.092534ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
6872025-01-29T07:07:29.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 31.129911ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
6882025-01-29T07:07:29.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 212.764274ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
6892025-01-29T07:07:29.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 149.881473ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
6902025-01-29T07:07:29.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 91.520116ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
6912025-01-29T07:07:29.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 211.005958ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
6922025-01-29T07:07:29.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 177.023375ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
6932025-01-29T07:07:29.892ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6942025-01-29T07:07:29.892ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6952025-01-29T07:07:29.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 365.516353ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
6962025-01-29T07:07:30.007ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6972025-01-29T07:07:30.007ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6982025-01-29T07:07:30.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 380.512031ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
6992025-01-29T07:07:30.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 400.020151ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7002025-01-29T07:07:30.240ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
7012025-01-29T07:07:30.240ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
7022025-01-29T07:07:30.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 1.092148988s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7032025-01-29T07:07:30.285ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
7042025-01-29T07:07:30.285ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
7052025-01-29T07:07:30.301ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4750490848513365636 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
7062025-01-29T07:07:30.302ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 617470551740920593 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
7072025-01-29T07:07:30.343ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7082025-01-29T07:07:30.343ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7092025-01-29T07:07:30.366ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7102025-01-29T07:07:30.366ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7112025-01-29T07:07:30.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 673.525947ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7122025-01-29T07:07:30.439ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7132025-01-29T07:07:30.439ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7142025-01-29T07:07:30.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 931.57225ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7152025-01-29T07:07:30.531ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7162025-01-29T07:07:30.531ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7172025-01-29T07:07:30.564ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6e725a65-3e84-4bcb-8d5c-2bc10a3849f4) file = sled-agent/src/nexus.rs:530 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
7182025-01-29T07:07:30.565ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192025-01-29T07:07:30.597ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202025-01-29T07:07:30.597ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212025-01-29T07:07:30.598ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7222025-01-29T07:07:30.598ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232025-01-29T07:07:30.635ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7242025-01-29T07:07:30.686ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7252025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7262025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7282025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7302025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7322025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7342025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7362025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7382025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7402025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7422025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7442025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7462025-01-29T07:07:30.686ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472025-01-29T07:07:30.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8419130655975364766 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
7482025-01-29T07:07:30.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12699699364153789148 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
7492025-01-29T07:07:31.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 1.153042065s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7502025-01-29T07:07:31.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 1.113021435s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7512025-01-29T07:07:31.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 1.097200023s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7522025-01-29T07:07:32.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 1.212271173s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7532025-01-29T07:07:32.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 740.450975ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7542025-01-29T07:07:32.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 1.317059078s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7552025-01-29T07:07:33.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 1.056219855s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7562025-01-29T07:07:33.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 760.334659ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7572025-01-29T07:07:33.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 716.650937ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7582025-01-29T07:07:34.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 918.323621ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7592025-01-29T07:07:34.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 1.110754392s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7602025-01-29T07:07:34.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 973.21392ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7612025-01-29T07:07:35.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 759.981329ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7622025-01-29T07:07:35.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 688.374993ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7632025-01-29T07:07:35.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 600.964438ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7642025-01-29T07:07:35.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b") failed: Property not found. retry in 1.217073405s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7652025-01-29T07:07:36.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669") failed: Property not found. retry in 524.63539ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7662025-01-29T07:07:36.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15") failed: Property not found. retry in 1.314568206s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7672025-01-29T07:07:37.497ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_38eceebd-5174-4206-b76c-bdfe4dc2356b
7682025-01-29T07:07:37.497ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_9ef8078f-3af0-4c43-bf26-bb6c97ef3669
7692025-01-29T07:07:37.497ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_e9debc14-429e-4cb4-936e-4e86e790ae15
7702025-01-29T07:07:37.497ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7712025-01-29T07:07:37.498ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-01-29T07:07:37.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10741347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65471 req_id = f6f51a23-380d-4bdb-990d-7d6a80fd4908 response_code = 204 uri = /omicron-zones
7732025-01-29T07:07:37.500ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7742025-01-29T07:07:37.842ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 133.273314ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7752025-01-29T07:07:38.022ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7762025-01-29T07:07:38.098ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-01-29T07:07:38.173ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7782025-01-29T07:07:38.173ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7792025-01-29T07:07:38.204ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7802025-01-29T07:07:38.205ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7812025-01-29T07:07:38.205ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7822025-01-29T07:07:38.234ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 38eceebd-5174-4206-b76c-bdfe4dc2356b (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9ef8078f-3af0-4c43-bf26-bb6c97ef3669 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e9debc14-429e-4cb4-936e-4e86e790ae15 (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1db33e29-ca4f-4e44-9fab-f588b3a0363b, kind: Service { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd }, name: Name("ntp-6873437b-d0f1-4496-b6ef-079a4573cbfd"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7832025-01-29T07:07:38.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61725
7842025-01-29T07:07:38.234ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-29T07:07:38.234ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-29T07:07:38.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7872025-01-29T07:07:38.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7882025-01-29T07:07:38.255ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7892025-01-29T07:07:38.255ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902025-01-29T07:07:38.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7912025-01-29T07:07:38.265ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
7922025-01-29T07:07:38.266ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
7932025-01-29T07:07:38.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942025-01-29T07:07:38.276ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7952025-01-29T07:07:38.308ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7962025-01-29T07:07:38.309ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7972025-01-29T07:07:38.309ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7982025-01-29T07:07:38.338ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 203, 196]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7992025-01-29T07:07:38.338ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8002025-01-29T07:07:38.339ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8012025-01-29T07:07:38.339ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8022025-01-29T07:07:38.339ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8032025-01-29T07:07:38.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8042025-01-29T07:07:38.363ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd file = illumos-utils/src/zone.rs:325
8052025-01-29T07:07:38.381ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd file = illumos-utils/src/zone.rs:363
8062025-01-29T07:07:39.013ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8072025-01-29T07:07:39.013ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8082025-01-29T07:07:39.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 68.880658ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8092025-01-29T07:07:39.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 77.107154ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8102025-01-29T07:07:39.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 265.364798ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8112025-01-29T07:07:39.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 476.798407ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8122025-01-29T07:07:40.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 1.044459119s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8132025-01-29T07:07:40.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4750490848513365636 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8142025-01-29T07:07:40.304ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 617470551740920593 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8152025-01-29T07:07:40.760ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8419130655975364766 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8162025-01-29T07:07:40.760ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12699699364153789148 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8172025-01-29T07:07:41.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 1.084513156s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8182025-01-29T07:07:42.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 1.040089703s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8192025-01-29T07:07:43.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 1.263479271s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8202025-01-29T07:07:44.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd") failed: Property not found. retry in 1.376946215s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8212025-01-29T07:07:45.955ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd
8222025-01-29T07:07:45.956ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232025-01-29T07:07:45.956ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242025-01-29T07:07:45.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7722309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61725 req_id = 4f2813a5-e3b0-4e10-8b1b-3a0ca793a23b response_code = 204 uri = /omicron-zones
8252025-01-29T07:07:45.958ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8262025-01-29T07:07:45.988ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272025-01-29T07:07:45.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45149
8282025-01-29T07:07:45.997ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8292025-01-29T07:07:45.997ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45149 req_id = 0f22c54a-8eb6-4d6d-8959-f31fcde6cde7 response_code = 500 uri = /timesync
8302025-01-29T07:07:46.000ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312025-01-29T07:07:46.109ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-01-29T07:07:46.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42452
8332025-01-29T07:07:50.119ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8342025-01-29T07:07:50.119ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009014 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42452 req_id = 6ef32e88-84d3-4029-883b-a0fcaac9798c response_code = 500 uri = /timesync
8352025-01-29T07:07:50.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4895625182862926408 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8362025-01-29T07:07:50.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5227172379602218696 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8372025-01-29T07:07:50.121ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427711084385855643 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8382025-01-29T07:07:50.122ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8392025-01-29T07:07:50.219ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-29T07:07:50.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60196
8412025-01-29T07:07:50.229ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8422025-01-29T07:07:50.229ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60196 req_id = ce50c415-b179-4c82-8ade-046c628896b2 response_code = 500 uri = /timesync
8432025-01-29T07:07:50.231ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442025-01-29T07:07:50.306ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4750490848513365636 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8452025-01-29T07:07:50.306ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 617470551740920593 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8462025-01-29T07:07:50.385ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-01-29T07:07:50.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35423
8482025-01-29T07:07:50.763ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8419130655975364766 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8492025-01-29T07:07:50.763ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12699699364153789148 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8502025-01-29T07:07:54.009ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 256.152561ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8512025-01-29T07:07:54.764ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6873437b-d0f1-4496-b6ef-079a4573cbfd': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8522025-01-29T07:07:54.765ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008959 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35423 req_id = 88b4b0bd-04cd-440a-a244-c1db92f85a02 response_code = 500 uri = /timesync
8532025-01-29T07:07:54.766ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8542025-01-29T07:07:54.920ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8552025-01-29T07:07:54.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33396
8562025-01-29T07:07:54.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33396 req_id = fc0d6b49-217c-478b-b89e-cc914082455a response_code = 200 uri = /timesync
8572025-01-29T07:07:54.932ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.066186957 } file = sled-agent/src/rack_setup/service.rs:743
8582025-01-29T07:07:54.932ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8592025-01-29T07:07:55.253ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8602025-01-29T07:07:55.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61253
8612025-01-29T07:07:55.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61253 req_id = 3c79fc9e-4edc-4de1-93c8-e613879581e7 response_code = 200 uri = /timesync
8622025-01-29T07:07:55.264ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.06528417 } file = sled-agent/src/rack_setup/service.rs:743
8632025-01-29T07:07:55.264ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8642025-01-29T07:07:55.484ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8652025-01-29T07:07:55.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36066
8662025-01-29T07:07:55.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36066 req_id = 1de8ecc8-27ce-43e6-b970-2ed645a65593 response_code = 200 uri = /timesync
8672025-01-29T07:07:55.495ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.064657636 } file = sled-agent/src/rack_setup/service.rs:743
8682025-01-29T07:07:55.495ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8692025-01-29T07:07:55.903ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8702025-01-29T07:07:55.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60985
8712025-01-29T07:07:55.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60985 req_id = f88ae68e-aea1-431f-9655-a29aae8c074e response_code = 200 uri = /timesync
8722025-01-29T07:07:55.914ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.066473551 } file = sled-agent/src/rack_setup/service.rs:743
8732025-01-29T07:07:55.914ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8742025-01-29T07:07:56.326ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3688080719819978056 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8752025-01-29T07:07:56.326ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16353957109888940350 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
8762025-01-29T07:07:56.364ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-29T07:07:56.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40298
8782025-01-29T07:07:56.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40298 req_id = 379113d3-92d1-49b7-b2de-32fb9af06a55 response_code = 200 uri = /timesync
8792025-01-29T07:07:56.377ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.06522204 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-29T07:07:56.377ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812025-01-29T07:07:56.642ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8822025-01-29T07:07:56.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45364
8832025-01-29T07:07:56.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45364 req_id = 011d7d81-d992-44be-9751-959253a7edca response_code = 200 uri = /timesync
8842025-01-29T07:07:56.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716986, ip_addr: 23.150.41.122, stratum: 5, ref_time: 1738134476.3323443, correction: -0.069881864 } file = sled-agent/src/rack_setup/service.rs:743
8852025-01-29T07:07:56.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8862025-01-29T07:07:57.273ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8872025-01-29T07:07:57.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36087
8882025-01-29T07:07:57.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36087 req_id = 1ce37fb5-814d-426c-aa09-2db3ef7ba50a response_code = 200 uri = /timesync
8892025-01-29T07:07:57.283ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.068168253 } file = sled-agent/src/rack_setup/service.rs:743
8902025-01-29T07:07:57.283ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8912025-01-29T07:07:58.162ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8922025-01-29T07:07:58.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32802
8932025-01-29T07:07:58.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8349 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32802 req_id = 974d1eb9-658c-48b2-9984-0b5f1cefea19 response_code = 200 uri = /timesync
8942025-01-29T07:07:58.174ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.065733112 } file = sled-agent/src/rack_setup/service.rs:743
8952025-01-29T07:07:58.174ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8962025-01-29T07:07:58.937ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972025-01-29T07:07:58.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39663
8982025-01-29T07:07:58.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39663 req_id = 03f84195-1bce-4779-b86e-72d2faf617c5 response_code = 200 uri = /timesync
8992025-01-29T07:07:58.947ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1614586083, ip_addr: 96.60.160.227, stratum: 2, ref_time: 1738134478.5847611, correction: -0.06471204 } file = sled-agent/src/rack_setup/service.rs:743
9002025-01-29T07:07:58.947ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9012025-01-29T07:07:59.857ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9022025-01-29T07:07:59.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42754
9032025-01-29T07:07:59.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42754 req_id = 89c840a0-dce6-4e28-a643-db887dd6dc08 response_code = 200 uri = /timesync
9042025-01-29T07:07:59.868ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.062477086 } file = sled-agent/src/rack_setup/service.rs:743
9052025-01-29T07:07:59.868ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9062025-01-29T07:08:00.478ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4895625182862926408 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9072025-01-29T07:08:00.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5227172379602218696 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9082025-01-29T07:08:00.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427711084385855643 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9092025-01-29T07:08:00.661ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4750490848513365636 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9102025-01-29T07:08:00.662ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 617470551740920593 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9112025-01-29T07:08:00.676ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60805
9122025-01-29T07:08:00.676ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60805 req_id = d7ed04db-b28f-4ebd-956f-0c0dc7a53209 response_code = 200 uri = /baseboard
9132025-01-29T07:08:01.118ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8419130655975364766 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9142025-01-29T07:08:01.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12699699364153789148 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9152025-01-29T07:08:01.339ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162025-01-29T07:08:01.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41241
9172025-01-29T07:08:01.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41241 req_id = 2857b474-b357-4e53-878e-acd44dd559a6 response_code = 200 uri = /timesync
9182025-01-29T07:08:01.351ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.058591414 } file = sled-agent/src/rack_setup/service.rs:743
9192025-01-29T07:08:01.351ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-01-29T07:08:02.452ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9212025-01-29T07:08:02.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46514
9222025-01-29T07:08:02.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46514 req_id = 239473da-cec1-4332-88a6-07b3446bfa65 response_code = 200 uri = /timesync
9232025-01-29T07:08:02.464ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1738134472.5026436, correction: -0.056219656 } file = sled-agent/src/rack_setup/service.rs:743
9242025-01-29T07:08:02.464ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9252025-01-29T07:08:03.874ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9262025-01-29T07:08:03.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37692
9272025-01-29T07:08:03.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37692 req_id = 8c33c1a4-fe5c-4e74-814b-d819db096584 response_code = 200 uri = /timesync
9282025-01-29T07:08:03.887ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1614586083, ip_addr: 96.60.160.227, stratum: 2, ref_time: 1738134482.8059466, correction: -0.050232105 } file = sled-agent/src/rack_setup/service.rs:743
9292025-01-29T07:08:03.887ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9302025-01-29T07:08:06.317ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9312025-01-29T07:08:06.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64858
9322025-01-29T07:08:06.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3688080719819978056 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9332025-01-29T07:08:06.323ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16353957109888940350 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9342025-01-29T07:08:06.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64858 req_id = dcebe7ca-f443-4551-9124-0cab559cfec5 response_code = 200 uri = /timesync
9352025-01-29T07:08:06.346ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1614586083, ip_addr: 96.60.160.227, stratum: 2, ref_time: 1738134485.4393084, correction: -0.043258928 } file = sled-agent/src/rack_setup/service.rs:743
9362025-01-29T07:08:06.346ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
9372025-01-29T07:08:06.376ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 38eceebd-5174-4206-b76c-bdfe4dc2356b (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9ef8078f-3af0-4c43-bf26-bb6c97ef3669 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e9debc14-429e-4cb4-936e-4e86e790ae15 (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1db33e29-ca4f-4e44-9fab-f588b3a0363b, kind: Service { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd }, name: Name("ntp-6873437b-d0f1-4496-b6ef-079a4573cbfd"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a811b2e4-ab2a-43bc-9751-f64329df361f (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } } } }, OmicronZoneConfig { id: 99ad43c0-640a-41ab-b6fb-0d118f044e97 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } } } }, OmicronZoneConfig { id: 776863ef-2523-4613-989d-75d31ad33b5a (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8b318657-33d6-4b9d-94a3-38d7ab7b0acc (service), filesystem_pool: Some(ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9382025-01-29T07:08:06.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45386
9392025-01-29T07:08:06.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9402025-01-29T07:08:06.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9412025-01-29T07:08:06.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9422025-01-29T07:08:06.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9432025-01-29T07:08:06.398ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9442025-01-29T07:08:06.398ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9452025-01-29T07:08:06.407ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9462025-01-29T07:08:06.407ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9472025-01-29T07:08:06.416ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9482025-01-29T07:08:06.416ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9492025-01-29T07:08:06.426ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9502025-01-29T07:08:06.426ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9512025-01-29T07:08:06.435ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9522025-01-29T07:08:06.435ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9532025-01-29T07:08:06.446ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9542025-01-29T07:08:06.446ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9552025-01-29T07:08:06.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9562025-01-29T07:08:06.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
9572025-01-29T07:08:06.455ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
9582025-01-29T07:08:06.455ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9592025-01-29T07:08:06.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9602025-01-29T07:08:06.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9612025-01-29T07:08:06.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9622025-01-29T07:08:06.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9632025-01-29T07:08:06.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9642025-01-29T07:08:06.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a file = illumos-utils/src/zone.rs:325
9652025-01-29T07:08:06.637ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97 file = illumos-utils/src/zone.rs:325
9662025-01-29T07:08:06.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f file = illumos-utils/src/zone.rs:325
9672025-01-29T07:08:06.645ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb file = illumos-utils/src/zone.rs:325
9682025-01-29T07:08:06.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc file = illumos-utils/src/zone.rs:325
9692025-01-29T07:08:06.654ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a file = illumos-utils/src/zone.rs:363
9702025-01-29T07:08:06.659ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97 file = illumos-utils/src/zone.rs:363
9712025-01-29T07:08:06.664ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f file = illumos-utils/src/zone.rs:363
9722025-01-29T07:08:06.668ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb file = illumos-utils/src/zone.rs:363
9732025-01-29T07:08:06.672ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc file = illumos-utils/src/zone.rs:363
9742025-01-29T07:08:09.262ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 534.791595ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
9752025-01-29T07:08:10.213ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9762025-01-29T07:08:10.213ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
9772025-01-29T07:08:10.220ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='776863ef-2523-4613-989d-75d31ad33b5a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9782025-01-29T07:08:10.220ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
9792025-01-29T07:08:10.269ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='99ad43c0-640a-41ab-b6fb-0d118f044e97'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9802025-01-29T07:08:10.269ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
9812025-01-29T07:08:10.277ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='8b318657-33d6-4b9d-94a3-38d7ab7b0acc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9822025-01-29T07:08:10.278ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
9832025-01-29T07:08:10.306ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a811b2e4-ab2a-43bc-9751-f64329df361f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9842025-01-29T07:08:10.307ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
9852025-01-29T07:08:10.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 34.78118ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
9862025-01-29T07:08:10.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 26.199084ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
9872025-01-29T07:08:10.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 117.05895ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
9882025-01-29T07:08:10.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 135.340941ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
9892025-01-29T07:08:10.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 30.487435ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
9902025-01-29T07:08:10.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 42.841861ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
9912025-01-29T07:08:10.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 273.987734ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
9922025-01-29T07:08:10.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 61.662366ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
9932025-01-29T07:08:10.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 69.757431ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
9942025-01-29T07:08:10.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 247.594003ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
9952025-01-29T07:08:10.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 113.89394ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
9962025-01-29T07:08:11.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 279.486007ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
9972025-01-29T07:08:11.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 121.906427ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
9982025-01-29T07:08:11.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 79.892478ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
9992025-01-29T07:08:11.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 126.423769ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10002025-01-29T07:08:11.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 154.438182ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10012025-01-29T07:08:11.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 326.466584ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10022025-01-29T07:08:11.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 452.46056ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10032025-01-29T07:08:11.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 342.83839ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10042025-01-29T07:08:11.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 436.350461ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10052025-01-29T07:08:11.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 349.436281ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10062025-01-29T07:08:11.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 1.093708462s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10072025-01-29T07:08:11.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 1.018468755s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10082025-01-29T07:08:11.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 504.047471ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10092025-01-29T07:08:11.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.057784694s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10102025-01-29T07:08:11.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 1.323484221s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10112025-01-29T07:08:12.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 1.032762679s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10122025-01-29T07:08:12.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 1.251193361s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10132025-01-29T07:08:12.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 519.128083ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10142025-01-29T07:08:12.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 869.841652ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10152025-01-29T07:08:13.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 1.325081168s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10162025-01-29T07:08:13.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 693.372544ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10172025-01-29T07:08:13.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 1.08983139s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10182025-01-29T07:08:13.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 689.661591ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10192025-01-29T07:08:13.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 1.352363439s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10202025-01-29T07:08:13.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 646.414875ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10212025-01-29T07:08:14.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 964.080204ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10222025-01-29T07:08:14.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.212770168s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10232025-01-29T07:08:14.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 705.103861ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10242025-01-29T07:08:14.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 997.141988ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10252025-01-29T07:08:15.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 508.020465ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10262025-01-29T07:08:15.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 976.759693ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10272025-01-29T07:08:15.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 952.666226ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10282025-01-29T07:08:15.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 767.037607ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10292025-01-29T07:08:15.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.237556291s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10302025-01-29T07:08:15.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 910.936455ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10312025-01-29T07:08:16.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 772.261266ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10322025-01-29T07:08:16.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 817.696111ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10332025-01-29T07:08:16.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 560.82307ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10342025-01-29T07:08:16.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 948.622892ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10352025-01-29T07:08:16.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 892.111119ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10362025-01-29T07:08:16.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 867.850446ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10372025-01-29T07:08:17.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 547.16555ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10382025-01-29T07:08:17.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 1.035070993s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10392025-01-29T07:08:17.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 724.670982ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10402025-01-29T07:08:17.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 768.339145ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10412025-01-29T07:08:17.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.278616678s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10422025-01-29T07:08:17.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 534.667952ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10432025-01-29T07:08:18.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 669.388891ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10442025-01-29T07:08:18.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 1.086496768s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10452025-01-29T07:08:18.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 866.717883ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10462025-01-29T07:08:18.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 1.056832831s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10472025-01-29T07:08:18.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 1.280142307s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10482025-01-29T07:08:19.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.165446899s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10492025-01-29T07:08:19.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 1.298991392s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10502025-01-29T07:08:19.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 1.010636039s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10512025-01-29T07:08:19.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 984.58578ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10522025-01-29T07:08:20.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 620.639128ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10532025-01-29T07:08:20.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb") failed: Property not found. retry in 1.468100783s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10542025-01-29T07:08:20.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a") failed: Property not found. retry in 1.40244269s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10552025-01-29T07:08:20.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 876.807787ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10562025-01-29T07:08:20.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc") failed: Property not found. retry in 1.446377601s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10572025-01-29T07:08:20.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f") failed: Property not found. retry in 1.042055634s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10582025-01-29T07:08:21.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97") failed: Property not found. retry in 1.399937661s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10592025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a
10602025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_99ad43c0-640a-41ab-b6fb-0d118f044e97
10612025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_a811b2e4-ab2a-43bc-9751-f64329df361f
10622025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb
10632025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_8b318657-33d6-4b9d-94a3-38d7ab7b0acc
10642025-01-29T07:08:22.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10652025-01-29T07:08:22.742ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10662025-01-29T07:08:22.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 16409123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45386 req_id = ccfa8e34-e1cb-4a66-8d54-7fdd9b7e0ba6 response_code = 204 uri = /omicron-zones
10672025-01-29T07:08:22.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63250
10682025-01-29T07:08:22.807ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 31466 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = aa0fa90e-bb7d-421c-a77c-a05c6212770b response_code = 500 uri = /cockroachdb
10692025-01-29T07:08:22.808ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aa0fa90e-bb7d-421c-a77c-a05c6212770b", "content-length": "124", "date": "Wed, 29 Jan 2025 07:08:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aa0fa90e-bb7d-421c-a77c-a05c6212770b" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 100.883966ms
10702025-01-29T07:08:22.935ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = 92b7a4b8-70f6-46a8-b90f-a16808fad962 response_code = 500 uri = /cockroachdb
10712025-01-29T07:08:22.936ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "92b7a4b8-70f6-46a8-b90f-a16808fad962", "content-length": "124", "date": "Wed, 29 Jan 2025 07:08:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "92b7a4b8-70f6-46a8-b90f-a16808fad962" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 66.750723ms
10722025-01-29T07:08:23.033ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 29920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = fc1aec36-b688-4313-8f64-2756bb9e31cc response_code = 500 uri = /cockroachdb
10732025-01-29T07:08:23.033ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fc1aec36-b688-4313-8f64-2756bb9e31cc", "content-length": "124", "date": "Wed, 29 Jan 2025 07:08:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fc1aec36-b688-4313-8f64-2756bb9e31cc" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 87.506228ms
10742025-01-29T07:08:23.151ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 29512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = 1d5545f2-74a0-45c8-8ace-7efed87659da response_code = 500 uri = /cockroachdb
10752025-01-29T07:08:23.151ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1d5545f2-74a0-45c8-8ace-7efed87659da", "content-length": "124", "date": "Wed, 29 Jan 2025 07:08:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1d5545f2-74a0-45c8-8ace-7efed87659da" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 187.766701ms
10762025-01-29T07:08:23.367ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_776863ef-2523-4613-989d-75d31ad33b5a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = 48891176-ba07-4841-a1e5-195ae9bca5f6 response_code = 500 uri = /cockroachdb
10772025-01-29T07:08:23.367ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48891176-ba07-4841-a1e5-195ae9bca5f6", "content-length": "124", "date": "Wed, 29 Jan 2025 07:08:22 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48891176-ba07-4841-a1e5-195ae9bca5f6" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 298.01488ms
10782025-01-29T07:08:23.696ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3752
10792025-01-29T07:08:33.939ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10802025-01-29T07:08:40.109ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10812025-01-29T07:08:40.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 16446548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:63250 req_id = 17f163c0-a286-45df-aaea-73e6b11a2897 response_code = 204 uri = /cockroachdb
10822025-01-29T07:08:40.118ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61252
10832025-01-29T07:08:40.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1828 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61252 req_id = 7acc4e68-93ef-4e02-ad94-96a4cf621518 response_code = 200 uri = /baseboard
10842025-01-29T07:08:40.131ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.499838682s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
10852025-01-29T07:08:40.167ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 38eceebd-5174-4206-b76c-bdfe4dc2356b (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9ef8078f-3af0-4c43-bf26-bb6c97ef3669 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: e9debc14-429e-4cb4-936e-4e86e790ae15 (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 1db33e29-ca4f-4e44-9fab-f588b3a0363b, kind: Service { id: 6873437b-d0f1-4496-b6ef-079a4573cbfd }, name: Name("ntp-6873437b-d0f1-4496-b6ef-079a4573cbfd"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 203, 196])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: a811b2e4-ab2a-43bc-9751-f64329df361f (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } } } }, OmicronZoneConfig { id: 99ad43c0-640a-41ab-b6fb-0d118f044e97 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } } } }, OmicronZoneConfig { id: 776863ef-2523-4613-989d-75d31ad33b5a (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8b318657-33d6-4b9d-94a3-38d7ab7b0acc (service), filesystem_pool: Some(ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9dce6d4-0cfa-43df-8a3d-cd9e06c378fb (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External } } } }, OmicronZoneConfig { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 20f094a8-c046-4dfe-9251-74c4f111b769 (service), filesystem_pool: Some(ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 843b5e15-211c-4e58-8221-57299c421beb (service), filesystem_pool: Some(ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 743ecea7-7289-4313-a63e-3da7b1094b32 (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3673bdc8-ba4d-4411-b1b6-6dfb57f34102 (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 3fb96885-2266-4af7-b095-f96c63818e88 (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } } } }, OmicronZoneConfig { id: 257c9d76-3f9b-47f7-8db1-0fa35016ba42 (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 7a0bd926-55ed-47bc-a49b-ed4eb603ef4d (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: e2d4e45d-0723-4b88-a467-2b4033ed6c59 (service), filesystem_pool: Some(ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067 (service), filesystem_pool: Some(ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External } } } }, OmicronZoneConfig { id: 47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866 (service), filesystem_pool: Some(ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External } } } }, OmicronZoneConfig { id: ef60584f-6043-412d-8758-45a09e606085 (service), filesystem_pool: Some(ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 932d5dd1-74bb-45ce-a8a4-8d531e17e098 (service), filesystem_pool: Some(ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External } } } }, OmicronZoneConfig { id: a85b058e-827d-4626-9db9-5026ca299e2a (service), filesystem_pool: Some(ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7e31c49e-367f-4cd2-a7d5-318a22542f1d (service), filesystem_pool: Some(ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External } } } }, OmicronZoneConfig { id: 223eb01a-6694-43e6-880e-e138c6d13ffb (service), filesystem_pool: Some(ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External } } } }, OmicronZoneConfig { id: 049e4739-8fda-4544-aa07-31df68ab75c6 (service), filesystem_pool: Some(ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External } } } }, OmicronZoneConfig { id: 3a8c380d-d789-4a34-a21c-d9a7010e3531 (service), filesystem_pool: Some(ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10862025-01-29T07:08:40.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53389
10872025-01-29T07:08:40.173ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10882025-01-29T07:08:40.173ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10892025-01-29T07:08:40.190ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10902025-01-29T07:08:40.190ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10912025-01-29T07:08:40.202ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10922025-01-29T07:08:40.202ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10932025-01-29T07:08:40.214ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10942025-01-29T07:08:40.214ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10952025-01-29T07:08:40.226ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10962025-01-29T07:08:40.226ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10972025-01-29T07:08:40.237ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10982025-01-29T07:08:40.237ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10992025-01-29T07:08:40.247ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-29T07:08:40.247ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11012025-01-29T07:08:40.258ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-29T07:08:40.258ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11032025-01-29T07:08:40.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-29T07:08:40.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11052025-01-29T07:08:40.282ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-29T07:08:40.282ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11072025-01-29T07:08:40.295ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-29T07:08:40.295ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11092025-01-29T07:08:40.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-29T07:08:40.307ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, kind: Crucible }, responder: ... }
11112025-01-29T07:08:40.318ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-29T07:08:40.319ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, kind: Crucible }, responder: ... }
11132025-01-29T07:08:40.331ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-29T07:08:40.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11152025-01-29T07:08:40.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-29T07:08:40.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11172025-01-29T07:08:40.354ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-29T07:08:40.354ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, kind: Crucible }, responder: ... }
11192025-01-29T07:08:40.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-29T07:08:40.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, kind: Crucible }, responder: ... }
11212025-01-29T07:08:40.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-29T07:08:40.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, kind: Crucible }, responder: ... }
11232025-01-29T07:08:40.388ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-29T07:08:40.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, kind: Crucible }, responder: ... }
11252025-01-29T07:08:40.400ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-29T07:08:40.400ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, kind: Crucible }, responder: ... }
11272025-01-29T07:08:40.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-01-29T07:08:40.412ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
11292025-01-29T07:08:40.413ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
11302025-01-29T07:08:40.414ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312025-01-29T07:08:40.603ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11322025-01-29T07:08:40.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11332025-01-29T07:08:40.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342025-01-29T07:08:40.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11352025-01-29T07:08:40.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362025-01-29T07:08:40.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372025-01-29T07:08:40.660ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382025-01-29T07:08:40.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11392025-01-29T07:08:40.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402025-01-29T07:08:40.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412025-01-29T07:08:40.852ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11422025-01-29T07:08:40.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-29T07:08:40.853ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-01-29T07:08:40.867ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11452025-01-29T07:08:40.867ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11462025-01-29T07:08:40.894ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11472025-01-29T07:08:40.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11482025-01-29T07:08:40.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11492025-01-29T07:08:40.896ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502025-01-29T07:08:40.896ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098 file = illumos-utils/src/zone.rs:325
11512025-01-29T07:08:40.903ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102 file = illumos-utils/src/zone.rs:325
11522025-01-29T07:08:40.909ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88 file = illumos-utils/src/zone.rs:325
11532025-01-29T07:08:40.915ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866 file = illumos-utils/src/zone.rs:325
11542025-01-29T07:08:40.920ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067 file = illumos-utils/src/zone.rs:325
11552025-01-29T07:08:40.927ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d file = illumos-utils/src/zone.rs:325
11562025-01-29T07:08:40.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6 file = illumos-utils/src/zone.rs:325
11572025-01-29T07:08:40.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a file = illumos-utils/src/zone.rs:325
11582025-01-29T07:08:41.078ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098 file = illumos-utils/src/zone.rs:363
11592025-01-29T07:08:41.083ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102 file = illumos-utils/src/zone.rs:363
11602025-01-29T07:08:41.089ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88 file = illumos-utils/src/zone.rs:363
11612025-01-29T07:08:41.094ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866 file = illumos-utils/src/zone.rs:363
11622025-01-29T07:08:41.099ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067 file = illumos-utils/src/zone.rs:363
11632025-01-29T07:08:41.105ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d file = illumos-utils/src/zone.rs:363
11642025-01-29T07:08:41.111ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6 file = illumos-utils/src/zone.rs:363
11652025-01-29T07:08:41.116ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a file = illumos-utils/src/zone.rs:363
11662025-01-29T07:08:41.122ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59 file = illumos-utils/src/zone.rs:325
11672025-01-29T07:08:41.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ef60584f-6043-412d-8758-45a09e606085 file = illumos-utils/src/zone.rs:325
11682025-01-29T07:08:41.135ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d file = illumos-utils/src/zone.rs:325
11692025-01-29T07:08:41.142ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb file = illumos-utils/src/zone.rs:325
11702025-01-29T07:08:41.149ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531 file = illumos-utils/src/zone.rs:325
11712025-01-29T07:08:41.158ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42 file = illumos-utils/src/zone.rs:325
11722025-01-29T07:08:41.225ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11732025-01-29T07:08:41.286ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11742025-01-29T07:08:41.287ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59 file = illumos-utils/src/zone.rs:363
11752025-01-29T07:08:41.334ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ef60584f-6043-412d-8758-45a09e606085 file = illumos-utils/src/zone.rs:363
11762025-01-29T07:08:41.376ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d file = illumos-utils/src/zone.rs:363
11772025-01-29T07:08:41.393ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb file = illumos-utils/src/zone.rs:363
11782025-01-29T07:08:41.407ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531 file = illumos-utils/src/zone.rs:363
11792025-01-29T07:08:41.419ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42 file = illumos-utils/src/zone.rs:363
11802025-01-29T07:08:41.495ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11812025-01-29T07:08:41.556ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11822025-01-29T07:08:41.615ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11832025-01-29T07:08:41.627ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11842025-01-29T07:08:41.627ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11852025-01-29T07:08:41.730ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 164, 98]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11862025-01-29T07:08:41.730ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11872025-01-29T07:08:41.734ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11882025-01-29T07:08:41.734ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11892025-01-29T07:08:41.844ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 237, 58]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11902025-01-29T07:08:41.844ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11912025-01-29T07:08:41.852ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11922025-01-29T07:08:41.852ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11932025-01-29T07:08:41.971ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 139, 241]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11942025-01-29T07:08:41.971ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11952025-01-29T07:08:41.987ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11962025-01-29T07:08:41.988ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11972025-01-29T07:08:42.102ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 191, 253]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11982025-01-29T07:08:42.102ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11992025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12002025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12012025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12022025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12032025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12042025-01-29T07:08:42.105ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12052025-01-29T07:08:42.107ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12062025-01-29T07:08:42.107ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12072025-01-29T07:08:42.202ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 179, 122]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12082025-01-29T07:08:42.202ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12092025-01-29T07:08:42.206ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12102025-01-29T07:08:42.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12112025-01-29T07:08:42.271ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12122025-01-29T07:08:42.271ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12132025-01-29T07:08:42.275ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12142025-01-29T07:08:42.275ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12152025-01-29T07:08:42.275ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12162025-01-29T07:08:42.286ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12172025-01-29T07:08:42.287ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12182025-01-29T07:08:42.293ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12192025-01-29T07:08:42.296ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12202025-01-29T07:08:42.299ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-29T07:08:42.299ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-01-29T07:08:42.360ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-01-29T07:08:42.402ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8 file = illumos-utils/src/zone.rs:325
12242025-01-29T07:08:42.482ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb file = illumos-utils/src/zone.rs:325
12252025-01-29T07:08:42.488ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32 file = illumos-utils/src/zone.rs:325
12262025-01-29T07:08:42.495ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8 file = illumos-utils/src/zone.rs:363
12272025-01-29T07:08:42.501ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769 file = illumos-utils/src/zone.rs:325
12282025-01-29T07:08:42.508ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1 file = illumos-utils/src/zone.rs:325
12292025-01-29T07:08:42.513ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb file = illumos-utils/src/zone.rs:363
12302025-01-29T07:08:42.519ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32 file = illumos-utils/src/zone.rs:363
12312025-01-29T07:08:42.526ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769 file = illumos-utils/src/zone.rs:363
12322025-01-29T07:08:42.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1 file = illumos-utils/src/zone.rs:363
12332025-01-29T07:08:50.390ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9f832d64-9c3a-43a9-91d4-d0bd6ec8b364'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342025-01-29T07:08:51.093ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_726f1df1-097f-4118-903d-7cffb2ec5c36/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2ae3ecf6-db4f-49ae-a9fe-5dd2298b96ed'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12352025-01-29T07:08:51.397ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9fd835b7-cfed-4b4e-b298-8970ef9e2955'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362025-01-29T07:08:51.398ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_db2b1192-66c6-4615-a94b-80071566494f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1d9c9fbd-8436-4576-bf92-af2ace313f07'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372025-01-29T07:08:51.404ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382025-01-29T07:08:51.406ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ef60584f-6043-412d-8758-45a09e606085: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ba24217f-fe87-4e1a-b425-f36c12785f2f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12392025-01-29T07:08:51.407ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='97491ce7-e265-4ef0-bd53-580533b0c94e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402025-01-29T07:08:51.408ZINFOSledAgent (ServiceManager): Booting oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
12412025-01-29T07:08:51.452ZINFOSledAgent (ServiceManager): Booting oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
12422025-01-29T07:08:51.727ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
12432025-01-29T07:08:52.086ZINFOSledAgent (ServiceManager): Booting oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
12442025-01-29T07:08:52.099ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
12452025-01-29T07:08:52.114ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462025-01-29T07:08:52.114ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ef60584f-6043-412d-8758-45a09e606085 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
12472025-01-29T07:08:52.123ZINFOSledAgent (ServiceManager): Booting oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
12482025-01-29T07:08:52.130ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_99311bbe-9041-4ee9-9e49-88d0748815df/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='078108d5-ea31-4465-a83c-a543c1047bde'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12492025-01-29T07:08:52.130ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
12502025-01-29T07:08:52.138ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
12512025-01-29T07:08:52.890ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='3673bdc8-ba4d-4411-b1b6-6dfb57f34102'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522025-01-29T07:08:52.891ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
12532025-01-29T07:08:52.973ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4211c362-ec35-48af-a0ac-6413d4838a50'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12542025-01-29T07:08:52.973ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
12552025-01-29T07:08:53.131ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c196feef-7346-4e4f-b19c-8b3b0708c867/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0018e689-3312-497a-a3c5-0a448d6432cb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562025-01-29T07:08:53.132ZINFOSledAgent (ServiceManager): Booting oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
12572025-01-29T07:08:53.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 37.729277ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
12582025-01-29T07:08:53.362ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12592025-01-29T07:08:53.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 28.124598ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
12602025-01-29T07:08:53.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 71.654838ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
12612025-01-29T07:08:53.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 65.448309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
12622025-01-29T07:08:53.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 55.495497ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
12632025-01-29T07:08:53.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 54.174306ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
12642025-01-29T07:08:53.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 64.808764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
12652025-01-29T07:08:53.426ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
12662025-01-29T07:08:53.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 29.783613ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
12672025-01-29T07:08:53.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 49.406366ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
12682025-01-29T07:08:53.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 32.218661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
12692025-01-29T07:08:53.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 105.678139ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
12702025-01-29T07:08:53.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 120.649856ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
12712025-01-29T07:08:53.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 93.945814ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
12722025-01-29T07:08:53.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 59.753513ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
12732025-01-29T07:08:53.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 39.699689ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
12742025-01-29T07:08:53.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 116.91617ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
12752025-01-29T07:08:53.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 137.628001ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
12762025-01-29T07:08:53.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 126.417047ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
12772025-01-29T07:08:53.693ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12782025-01-29T07:08:53.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 58.810246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
12792025-01-29T07:08:53.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 146.601134ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
12802025-01-29T07:08:53.718ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812025-01-29T07:08:53.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 126.096537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
12822025-01-29T07:08:53.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 255.279327ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
12832025-01-29T07:08:53.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 255.819602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
12842025-01-29T07:08:53.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 43.308344ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
12852025-01-29T07:08:53.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 112.304994ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
12862025-01-29T07:08:53.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 297.997746ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
12872025-01-29T07:08:53.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 149.864404ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
12882025-01-29T07:08:53.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 162.822071ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
12892025-01-29T07:08:53.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 295.360334ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
12902025-01-29T07:08:53.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 185.061959ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
12912025-01-29T07:08:54.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 52.851939ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
12922025-01-29T07:08:54.012ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
12932025-01-29T07:08:54.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 130.532662ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
12942025-01-29T07:08:54.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 190.088245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
12952025-01-29T07:08:54.050ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
12962025-01-29T07:08:54.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 217.338587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
12972025-01-29T07:08:54.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 108.288185ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
12982025-01-29T07:08:54.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 570.939095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
12992025-01-29T07:08:54.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 85.373172ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13002025-01-29T07:08:54.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 165.53202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13012025-01-29T07:08:54.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 368.018528ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
13022025-01-29T07:08:54.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 412.789569ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
13032025-01-29T07:08:54.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 328.679763ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
13042025-01-29T07:08:54.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 457.098736ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
13052025-01-29T07:08:54.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 446.315165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
13062025-01-29T07:08:54.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 131.125556ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13072025-01-29T07:08:54.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 142.833957ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13082025-01-29T07:08:54.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 525.369534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
13092025-01-29T07:08:54.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 420.114476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
13102025-01-29T07:08:54.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 59.547186ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13112025-01-29T07:08:54.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 431.711263ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13122025-01-29T07:08:54.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 209.118337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13132025-01-29T07:08:54.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 449.069764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
13142025-01-29T07:08:54.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 547.876129ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13152025-01-29T07:08:54.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 146.465667ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13162025-01-29T07:08:54.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 581.043708ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13172025-01-29T07:08:54.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 66.40333ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13182025-01-29T07:08:54.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 409.432232ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
13192025-01-29T07:08:54.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 637.29293ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
13202025-01-29T07:08:54.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 176.932932ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13212025-01-29T07:08:54.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 62.548564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13222025-01-29T07:08:54.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 990.916639ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13232025-01-29T07:08:54.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 860.192183ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
13242025-01-29T07:08:54.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 158.680069ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13252025-01-29T07:08:54.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 803.809485ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
13262025-01-29T07:08:54.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 589.546915ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
13272025-01-29T07:08:54.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.170755868s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
13282025-01-29T07:08:54.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 752.918762ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
13292025-01-29T07:08:54.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 410.110175ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13302025-01-29T07:08:54.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 825.815252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13312025-01-29T07:08:54.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 921.51377ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
13322025-01-29T07:08:54.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.19519796s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
13332025-01-29T07:08:54.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 462.003368ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13342025-01-29T07:08:54.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 736.925747ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13352025-01-29T07:08:54.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.165428426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
13362025-01-29T07:08:54.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 887.303616ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13372025-01-29T07:08:55.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 700.60549ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13382025-01-29T07:08:55.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 988.594541ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
13392025-01-29T07:08:55.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 872.890369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
13402025-01-29T07:08:55.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 523.672639ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13412025-01-29T07:08:55.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.367865348s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13422025-01-29T07:08:55.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.471332141s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
13432025-01-29T07:08:55.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 696.761954ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13442025-01-29T07:08:55.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.137449562s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
13452025-01-29T07:08:55.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 826.227924ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13462025-01-29T07:08:56.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.198303597s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13472025-01-29T07:08:56.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.421893274s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
13482025-01-29T07:08:56.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.063166963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
13492025-01-29T07:08:56.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 743.729421ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13502025-01-29T07:08:56.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.465326758s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
13512025-01-29T07:08:56.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 509.916132ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
13522025-01-29T07:08:56.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.151845616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
13532025-01-29T07:08:56.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.249518225s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13542025-01-29T07:08:56.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.432138319s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
13552025-01-29T07:08:56.429ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13562025-01-29T07:08:56.430ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572025-01-29T07:08:56.432ZINFOSledAgent (ServiceManager): Booting oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13582025-01-29T07:08:56.444ZINFOSledAgent (ServiceManager): Booting oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13592025-01-29T07:08:56.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.413159989s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
13602025-01-29T07:08:56.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.332650698s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13612025-01-29T07:08:56.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 27.473642ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13622025-01-29T07:08:56.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 56.62034ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13632025-01-29T07:08:56.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.425270177s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
13642025-01-29T07:08:56.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 146.871517ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13652025-01-29T07:08:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 147.113212ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13662025-01-29T07:08:56.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.271041488s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13672025-01-29T07:08:56.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.030749115s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13682025-01-29T07:08:56.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 164.307463ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13692025-01-29T07:08:56.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 280.563147ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13702025-01-29T07:08:57.131ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.56023053s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
13712025-01-29T07:08:57.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.01359776s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
13722025-01-29T07:08:57.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 964.888417ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
13732025-01-29T07:08:57.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 525.058358ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13742025-01-29T07:08:57.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 766.115704ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13752025-01-29T07:08:57.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 652.783871ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13762025-01-29T07:08:57.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 309.708709ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13772025-01-29T07:08:57.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.19802202s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
13782025-01-29T07:08:57.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 877.392524ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
13792025-01-29T07:08:57.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 933.03947ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
13802025-01-29T07:08:57.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 781.769367ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13812025-01-29T07:08:57.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 921.9594ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
13822025-01-29T07:08:57.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 579.32185ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13832025-01-29T07:08:57.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 502.793828ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13842025-01-29T07:08:57.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 694.364265ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
13852025-01-29T07:08:57.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 766.471839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
13862025-01-29T07:08:57.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.11755603s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
13872025-01-29T07:08:57.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.154001854s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
13882025-01-29T07:08:58.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 952.821858ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
13892025-01-29T07:08:58.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.454028371s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
13902025-01-29T07:08:58.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 610.355604ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
13912025-01-29T07:08:58.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.175317706s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
13922025-01-29T07:08:58.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 880.286371ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
13932025-01-29T07:08:58.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.004914984s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
13942025-01-29T07:08:58.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.111714626s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
13952025-01-29T07:08:58.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 539.802452ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
13962025-01-29T07:08:58.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 764.419991ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
13972025-01-29T07:08:58.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 860.609347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
13982025-01-29T07:08:58.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 996.623995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
13992025-01-29T07:08:58.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 851.12316ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14002025-01-29T07:08:58.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.492158645s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14012025-01-29T07:08:58.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.297178231s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14022025-01-29T07:08:58.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.189507278s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
14032025-01-29T07:08:58.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 961.408749ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14042025-01-29T07:08:58.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 708.766068ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14052025-01-29T07:08:58.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.244690112s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
14062025-01-29T07:08:59.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 989.401199ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14072025-01-29T07:08:59.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.048906396s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
14082025-01-29T07:08:59.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 797.481347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14092025-01-29T07:08:59.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.449386697s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
14102025-01-29T07:08:59.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.223091332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14112025-01-29T07:08:59.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.393966334s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
14122025-01-29T07:08:59.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 994.751625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
14132025-01-29T07:08:59.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.430366768s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
14142025-01-29T07:08:59.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 524.117329ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14152025-01-29T07:08:59.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 528.953211ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
14162025-01-29T07:08:59.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.191570614s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
14172025-01-29T07:08:59.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.415148751s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14182025-01-29T07:08:59.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 751.491448ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14192025-01-29T07:08:59.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 593.459093ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14202025-01-29T07:08:59.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.498203233s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14212025-01-29T07:08:59.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.361249471s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14222025-01-29T07:08:59.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.307209829s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
14232025-01-29T07:09:00.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 844.803661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
14242025-01-29T07:09:00.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 644.263232ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14252025-01-29T07:09:00.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 529.090777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14262025-01-29T07:09:00.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 575.171705ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
14272025-01-29T07:09:00.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.108210728s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
14282025-01-29T07:09:00.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.253369119s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
14292025-01-29T07:09:00.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.136627614s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14302025-01-29T07:09:00.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.187736031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14312025-01-29T07:09:00.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 896.720919ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14322025-01-29T07:09:00.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.468929248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
14332025-01-29T07:09:00.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.446024785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14342025-01-29T07:09:00.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 976.717853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
14352025-01-29T07:09:00.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.293121588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
14362025-01-29T07:09:00.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 641.2388ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14372025-01-29T07:09:00.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.05585532s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
14382025-01-29T07:09:00.758ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14392025-01-29T07:09:00.758ZINFOSledAgent (ServiceManager): Booting oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14402025-01-29T07:09:00.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.262834682s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
14412025-01-29T07:09:00.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 550.804381ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
14422025-01-29T07:09:01.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 961.923853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14432025-01-29T07:09:01.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 36.636259ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14442025-01-29T07:09:01.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 51.267557ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14452025-01-29T07:09:01.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 199.97042ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14462025-01-29T07:09:01.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.476331103s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
14472025-01-29T07:09:01.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.231301543s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14482025-01-29T07:09:01.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 391.697772ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14492025-01-29T07:09:01.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.152906442s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14502025-01-29T07:09:01.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 652.764603ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
14512025-01-29T07:09:01.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 582.43076ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14522025-01-29T07:09:01.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.304405032s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
14532025-01-29T07:09:01.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 678.585248ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14542025-01-29T07:09:01.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 885.674379ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14552025-01-29T07:09:01.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 832.548406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
14562025-01-29T07:09:01.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 505.326453ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
14572025-01-29T07:09:01.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 962.775386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14582025-01-29T07:09:01.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 847.781415ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14592025-01-29T07:09:01.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.445948055s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
14602025-01-29T07:09:01.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 861.041813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14612025-01-29T07:09:02.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.139932245s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
14622025-01-29T07:09:02.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 977.485652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14632025-01-29T07:09:02.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.425577329s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
14642025-01-29T07:09:02.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.270041266s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
14652025-01-29T07:09:02.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 578.096774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14662025-01-29T07:09:02.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.41399838s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
14672025-01-29T07:09:02.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 777.709504ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14682025-01-29T07:09:02.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 992.709931ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
14692025-01-29T07:09:02.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.260250272s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
14702025-01-29T07:09:02.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 550.895695ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14712025-01-29T07:09:02.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.4426566s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14722025-01-29T07:09:02.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.36335291s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14732025-01-29T07:09:02.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.051767215s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14742025-01-29T07:09:02.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 998.496764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14752025-01-29T07:09:02.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.153216515s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14762025-01-29T07:09:02.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.39168767s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
14772025-01-29T07:09:02.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.226460658s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
14782025-01-29T07:09:02.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 983.766241ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14792025-01-29T07:09:02.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 526.495591ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14802025-01-29T07:09:03.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 699.612696ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14812025-01-29T07:09:03.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 777.580605ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14822025-01-29T07:09:03.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.119784426s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
14832025-01-29T07:09:03.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.414279525s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
14842025-01-29T07:09:03.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 576.568355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
14852025-01-29T07:09:03.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 944.422876ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
14862025-01-29T07:09:03.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.448039582s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
14872025-01-29T07:09:03.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 652.327001ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
14882025-01-29T07:09:03.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.089051237s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
14892025-01-29T07:09:03.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 954.275309ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
14902025-01-29T07:09:03.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 840.017296ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
14912025-01-29T07:09:03.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.351177485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
14922025-01-29T07:09:03.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 658.612732ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
14932025-01-29T07:09:03.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 505.896791ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
14942025-01-29T07:09:03.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.418373923s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
14952025-01-29T07:09:03.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.044404305s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
14962025-01-29T07:09:03.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 759.54727ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
14972025-01-29T07:09:03.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.491690402s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
14982025-01-29T07:09:04.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 507.249415ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
14992025-01-29T07:09:04.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.485693828s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15002025-01-29T07:09:04.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 642.397895ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
15012025-01-29T07:09:04.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.064299546s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15022025-01-29T07:09:04.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 595.207331ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
15032025-01-29T07:09:04.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.474927542s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
15042025-01-29T07:09:04.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 632.672777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15052025-01-29T07:09:04.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 685.071647ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
15062025-01-29T07:09:04.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.498257429s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
15072025-01-29T07:09:04.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 762.641781ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
15082025-01-29T07:09:04.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.299166188s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
15092025-01-29T07:09:04.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 508.002901ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
15102025-01-29T07:09:04.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.005440288s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
15112025-01-29T07:09:04.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 836.810423ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15122025-01-29T07:09:04.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 1.354889509s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
15132025-01-29T07:09:04.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.320094315s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
15142025-01-29T07:09:04.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 611.213735ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
15152025-01-29T07:09:04.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 579.406823ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
15162025-01-29T07:09:05.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.17824604s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15172025-01-29T07:09:05.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 827.391029ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15182025-01-29T07:09:05.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.256477798s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
15192025-01-29T07:09:05.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.136155525s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
15202025-01-29T07:09:05.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 519.613637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15212025-01-29T07:09:05.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 964.855608ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
15222025-01-29T07:09:05.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 851.855775ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
15232025-01-29T07:09:05.423ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15242025-01-29T07:09:05.427ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15252025-01-29T07:09:05.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.422446597s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
15262025-01-29T07:09:05.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 567.658958ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15272025-01-29T07:09:05.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 749.742548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15282025-01-29T07:09:05.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 648.434783ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
15292025-01-29T07:09:05.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.485467904s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
15302025-01-29T07:09:05.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 631.398244ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
15312025-01-29T07:09:05.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 992.801071ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
15322025-01-29T07:09:05.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.17479934s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15332025-01-29T07:09:05.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 757.22815ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15342025-01-29T07:09:05.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 712.163345ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
15352025-01-29T07:09:06.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 639.843092ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
15362025-01-29T07:09:06.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 525.558952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15372025-01-29T07:09:06.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.365756465s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
15382025-01-29T07:09:06.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 1.453035538s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
15392025-01-29T07:09:06.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 867.582231ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15402025-01-29T07:09:06.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.180924241s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
15412025-01-29T07:09:06.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 960.742268ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
15422025-01-29T07:09:06.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 645.283926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
15432025-01-29T07:09:06.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 918.818478ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
15442025-01-29T07:09:06.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 674.814425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15452025-01-29T07:09:06.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.272110214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
15462025-01-29T07:09:06.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 684.92261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
15472025-01-29T07:09:06.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 42.043827ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15482025-01-29T07:09:06.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 146.294466ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15492025-01-29T07:09:06.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 283.312119ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15502025-01-29T07:09:06.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 683.93887ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15512025-01-29T07:09:06.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.382272422s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
15522025-01-29T07:09:06.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.472948436s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
15532025-01-29T07:09:06.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 625.418116ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15542025-01-29T07:09:06.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.142231482s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
15552025-01-29T07:09:06.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 715.307272ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
15562025-01-29T07:09:06.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 574.518348ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15572025-01-29T07:09:06.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.00708956s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
15582025-01-29T07:09:07.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 879.230945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15592025-01-29T07:09:07.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 822.374359ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15602025-01-29T07:09:07.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.34851539s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
15612025-01-29T07:09:07.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.161374615s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
15622025-01-29T07:09:07.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.236314948s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15632025-01-29T07:09:07.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.482440165s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
15642025-01-29T07:09:07.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.340522693s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
15652025-01-29T07:09:07.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 657.323887ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15662025-01-29T07:09:07.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 505.720405ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15672025-01-29T07:09:07.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.372660154s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
15682025-01-29T07:09:07.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 675.360296ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15692025-01-29T07:09:07.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.210326918s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
15702025-01-29T07:09:07.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.37082368s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
15712025-01-29T07:09:07.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.241224674s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
15722025-01-29T07:09:07.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 946.555249ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
15732025-01-29T07:09:07.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 971.038154ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15742025-01-29T07:09:07.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 696.97136ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15752025-01-29T07:09:07.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 866.662975ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15762025-01-29T07:09:07.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.440570161s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
15772025-01-29T07:09:07.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.496863s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
15782025-01-29T07:09:08.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.4381326s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
15792025-01-29T07:09:08.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 756.774189ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
15802025-01-29T07:09:08.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 726.350435ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
15812025-01-29T07:09:08.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.176903542s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
15822025-01-29T07:09:08.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 890.741372ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
15832025-01-29T07:09:08.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 674.857806ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15842025-01-29T07:09:08.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 625.188503ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
15852025-01-29T07:09:08.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 581.476803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
15862025-01-29T07:09:08.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.456737328s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
15872025-01-29T07:09:08.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 1.274417951s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
15882025-01-29T07:09:08.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.194949259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
15892025-01-29T07:09:08.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 843.597778ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
15902025-01-29T07:09:08.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 929.879115ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
15912025-01-29T07:09:08.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 667.654211ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
15922025-01-29T07:09:08.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.175437816s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
15932025-01-29T07:09:08.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 788.263012ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
15942025-01-29T07:09:08.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.38879571s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
15952025-01-29T07:09:08.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 932.849433ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
15962025-01-29T07:09:09.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 548.316484ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
15972025-01-29T07:09:09.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.180787994s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
15982025-01-29T07:09:09.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 521.586759ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
15992025-01-29T07:09:09.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.334862925s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
16002025-01-29T07:09:09.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.175516908s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
16012025-01-29T07:09:09.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 525.671516ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16022025-01-29T07:09:09.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.083290856s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
16032025-01-29T07:09:09.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.317801879s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
16042025-01-29T07:09:09.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.324386603s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
16052025-01-29T07:09:09.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.073097852s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
16062025-01-29T07:09:09.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 615.827524ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
16072025-01-29T07:09:09.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 932.439912ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
16082025-01-29T07:09:09.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.037363539s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16092025-01-29T07:09:09.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.181093905s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
16102025-01-29T07:09:09.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.406944445s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
16112025-01-29T07:09:09.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.013220105s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
16122025-01-29T07:09:09.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.247165558s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16132025-01-29T07:09:09.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.291785537s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
16142025-01-29T07:09:09.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb") failed: Property not found. retry in 1.422640724s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
16152025-01-29T07:09:10.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.453274279s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
16162025-01-29T07:09:10.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 1.330672983s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
16172025-01-29T07:09:10.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.122878157s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
16182025-01-29T07:09:10.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 1.356164742s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
16192025-01-29T07:09:10.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.365461075s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
16202025-01-29T07:09:10.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59") failed: Property not found. retry in 1.076216796s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
16212025-01-29T07:09:10.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.385330492s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
16222025-01-29T07:09:10.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d") failed: Property not found. retry in 1.293894978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
16232025-01-29T07:09:10.610ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44487
16242025-01-29T07:09:10.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769") failed: Property not found. retry in 1.444000597s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
16252025-01-29T07:09:10.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 751.613207ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
16262025-01-29T07:09:10.647ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25544 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44487 req_id = b2446307-412b-43bc-a57e-67c0987130c7 response_code = 200 uri = /baseboard
16272025-01-29T07:09:10.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 701.96085ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16282025-01-29T07:09:10.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ef60584f-6043-412d-8758-45a09e606085") failed: Property not found. retry in 1.450552398s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
16292025-01-29T07:09:10.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 514.952485ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
16302025-01-29T07:09:10.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 1.424664318s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
16312025-01-29T07:09:10.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.123236278s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
16322025-01-29T07:09:11.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.366007876s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
16332025-01-29T07:09:11.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 843.509052ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16342025-01-29T07:09:11.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.204152603s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
16352025-01-29T07:09:11.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102") failed: Property not found. retry in 1.377959864s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
16362025-01-29T07:09:11.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.214217482s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
16372025-01-29T07:09:11.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 886.161978ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16382025-01-29T07:09:11.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 799.064629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
16392025-01-29T07:09:11.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 676.207205ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
16402025-01-29T07:09:11.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a") failed: Property not found. retry in 1.387512152s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
16412025-01-29T07:09:11.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 997.024049ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
16422025-01-29T07:09:11.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067") failed: Property not found. retry in 1.346140467s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
16432025-01-29T07:09:11.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866") failed: Property not found. retry in 1.026982897s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
16442025-01-29T07:09:12.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 571.051949ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
16452025-01-29T07:09:12.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.387854639s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16462025-01-29T07:09:12.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531") failed: Property not found. retry in 1.184657442s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
16472025-01-29T07:09:12.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098") failed: Property not found. retry in 993.748262ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
16482025-01-29T07:09:12.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d") failed: Property not found. retry in 996.875818ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
16492025-01-29T07:09:12.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 504.527075ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16502025-01-29T07:09:12.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6") failed: Property not found. retry in 1.265227999s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
16512025-01-29T07:09:12.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32") failed: Property not found. retry in 1.348782676s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
16522025-01-29T07:09:12.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1") failed: Property not found. retry in 1.084963234s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
16532025-01-29T07:09:12.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8") failed: Property not found. retry in 1.092090579s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
16542025-01-29T07:09:12.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42") failed: Property not found. retry in 980.233202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
16552025-01-29T07:09:12.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb") failed: Property not found. retry in 1.170050213s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16562025-01-29T07:09:13.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.421358251s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16572025-01-29T07:09:13.811ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.717556698s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
16582025-01-29T07:09:14.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.343154234s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16592025-01-29T07:09:16.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.301672446s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16602025-01-29T07:09:17.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.054646795s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16612025-01-29T07:09:18.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.093502576s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16622025-01-29T07:09:19.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88") failed: Property not found. retry in 1.38571825s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16632025-01-29T07:09:19.899ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.859418753s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
16642025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_932d5dd1-74bb-45ce-a8a4-8d531e17e098
16652025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_3673bdc8-ba4d-4411-b1b6-6dfb57f34102
16662025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_3fb96885-2266-4af7-b095-f96c63818e88
16672025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_47a05086-3ba5-4ddd-a4e5-6b8c3e6bc866
16682025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_3d9f521b-7cb7-4e93-a4eb-95dcb8fa1067
16692025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_743ecea7-7289-4313-a63e-3da7b1094b32
16702025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_7e31c49e-367f-4cd2-a7d5-318a22542f1d
16712025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_049e4739-8fda-4544-aa07-31df68ab75c6
16722025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_a85b058e-827d-4626-9db9-5026ca299e2a
16732025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_242fa19c-184b-4bd6-a1bc-55c646ad7af8
16742025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_e2d4e45d-0723-4b88-a467-2b4033ed6c59
16752025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ef60584f-6043-412d-8758-45a09e606085
16762025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_20f094a8-c046-4dfe-9251-74c4f111b769
16772025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_7a0bd926-55ed-47bc-a49b-ed4eb603ef4d
16782025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_01a9123b-a40f-43f0-b4e1-1717d41c64e1
16792025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_223eb01a-6694-43e6-880e-e138c6d13ffb
16802025-01-29T07:09:21.111ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_3a8c380d-d789-4a34-a21c-d9a7010e3531
16812025-01-29T07:09:21.112ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_843b5e15-211c-4e58-8221-57299c421beb
16822025-01-29T07:09:21.112ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_257c9d76-3f9b-47f7-8db1-0fa35016ba42
16832025-01-29T07:09:21.141ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16842025-01-29T07:09:21.159ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16852025-01-29T07:09:21.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41018089 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53389 req_id = 42809fa7-fb94-4e5e-ac45-ffcdc02502ad response_code = 204 uri = /omicron-zones
16862025-01-29T07:09:21.323ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
16872025-01-29T07:09:21.402ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16882025-01-29T07:09:21.421ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
16892025-01-29T07:09:21.554ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
16902025-01-29T07:09:21.581ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16912025-01-29T07:09:21.729ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16922025-01-29T07:09:21.888ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16932025-01-29T07:09:21.990ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16942025-01-29T07:09:22.196ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16952025-01-29T07:09:22.402ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16962025-01-29T07:09:22.738ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16972025-01-29T07:09:22.898ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16982025-01-29T07:09:23.220ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16992025-01-29T07:09:23.652ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
17002025-01-29T07:09:24.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/8ce4b24b-37d8-4e36-9cd6-e54b908b3998/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
17012025-01-29T07:09:26.827ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6fe72897-8b2b-46ad-a34d-233b9e08ad0e", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8ce4b24b-37d8-4e36-9cd6-e54b908b3998\"", request_id: "6fe72897-8b2b-46ad-a34d-233b9e08ad0e" } file = sled-agent/src/rack_setup/service.rs:1070
17022025-01-29T07:09:27.639ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a9074ce5-2a96-45d1-a93a-19991ae067af", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8ce4b24b-37d8-4e36-9cd6-e54b908b3998\"", request_id: "a9074ce5-2a96-45d1-a93a-19991ae067af" } file = sled-agent/src/rack_setup/service.rs:1070
17032025-01-29T07:09:28.845ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "36a4c153-0048-40e2-ac7b-118324123433", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:28 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8ce4b24b-37d8-4e36-9cd6-e54b908b3998\"", request_id: "36a4c153-0048-40e2-ac7b-118324123433" } file = sled-agent/src/rack_setup/service.rs:1070
17042025-01-29T07:09:30.073ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1e37956a-b7de-4434-8107-1a35b2c7c087", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"8ce4b24b-37d8-4e36-9cd6-e54b908b3998\"", request_id: "1e37956a-b7de-4434-8107-1a35b2c7c087" } file = sled-agent/src/rack_setup/service.rs:1070
17052025-01-29T07:09:32.832ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dd1328ab-5ba1-4afe-9d6d-e01fa1e29e1a", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:32 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "dd1328ab-5ba1-4afe-9d6d-e01fa1e29e1a" } file = sled-agent/src/rack_setup/service.rs:1070
17062025-01-29T07:09:34.627ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e488a13b-4cea-4ddd-8f3d-6147e4475a27", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "e488a13b-4cea-4ddd-8f3d-6147e4475a27" } file = sled-agent/src/rack_setup/service.rs:1070
17072025-01-29T07:09:36.999ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "87ef72e2-5590-4072-9e60-a245bd6e6254", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "87ef72e2-5590-4072-9e60-a245bd6e6254" } file = sled-agent/src/rack_setup/service.rs:1070
17082025-01-29T07:09:40.314ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "60fef838-c035-4dbb-9ff1-59116cb7c7b7", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "60fef838-c035-4dbb-9ff1-59116cb7c7b7" } file = sled-agent/src/rack_setup/service.rs:1070
17092025-01-29T07:09:40.689ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54121
17102025-01-29T07:09:40.690ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54121 req_id = 55385705-3e67-4b79-b661-31917e893bc2 response_code = 200 uri = /baseboard
17112025-01-29T07:09:42.468ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ec9db806-0112-41ef-92c9-bb45a1b59741", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:42 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "ec9db806-0112-41ef-92c9-bb45a1b59741" } file = sled-agent/src/rack_setup/service.rs:1070
17122025-01-29T07:09:46.715ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3730989e-1141-46c6-9d6a-8e624de268f8", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "3730989e-1141-46c6-9d6a-8e624de268f8" } file = sled-agent/src/rack_setup/service.rs:1070
17132025-01-29T07:09:49.338ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c84807b8-640b-443a-a925-fe29395d57d2", "content-length": "173", "date": "Wed, 29 Jan 2025 07:09:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6e725a65-3e84-4bcb-8d5c-2bc10a3849f4\"", request_id: "c84807b8-640b-443a-a925-fe29395d57d2" } file = sled-agent/src/rack_setup/service.rs:1070
17142025-01-29T07:09:53.866ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:503 new_generation = 1 old_generation = 1 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
17152025-01-29T07:09:53.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58772
17162025-01-29T07:09:53.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17172025-01-29T07:09:53.957ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17182025-01-29T07:09:53.959ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
17192025-01-29T07:09:53.962ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
17202025-01-29T07:09:53.976ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17212025-01-29T07:09:53.976ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db2b1192-66c6-4615-a94b-80071566494f
17222025-01-29T07:09:54.000ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17232025-01-29T07:09:54.000ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd
17242025-01-29T07:09:54.022ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17252025-01-29T07:09:54.022ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe
17262025-01-29T07:09:54.042ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17272025-01-29T07:09:54.042ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13
17282025-01-29T07:09:54.064ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17292025-01-29T07:09:54.064ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c196feef-7346-4e4f-b19c-8b3b0708c867
17302025-01-29T07:09:54.086ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17312025-01-29T07:09:54.087ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2
17322025-01-29T07:09:54.106ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17332025-01-29T07:09:54.106ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2
17342025-01-29T07:09:54.124ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17352025-01-29T07:09:54.124ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_99311bbe-9041-4ee9-9e49-88d0748815df
17362025-01-29T07:09:54.144ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17372025-01-29T07:09:54.144ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_726f1df1-097f-4118-903d-7cffb2ec5c36
17382025-01-29T07:09:54.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58772 req_id = 52fbc633-e087-408e-afab-71d9ba20256c response_code = 200 uri = /inventory
17392025-01-29T07:09:55.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64237
17402025-01-29T07:09:55.155ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17412025-01-29T07:09:55.156ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17422025-01-29T07:09:55.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17432025-01-29T07:09:55.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17442025-01-29T07:09:55.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17452025-01-29T07:09:55.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17462025-01-29T07:09:55.157ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472025-01-29T07:09:55.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64237 req_id = 8b4bddb8-ca4e-47fa-be1a-778be01dd061 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17482025-01-29T07:09:55.158ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
17492025-01-29T07:09:55.161ZINFOSledAgent (RSS): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17502025-01-29T07:09:55.162ZINFOSledAgent (RSS): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17512025-01-29T07:09:55.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61665
17522025-01-29T07:09:55.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17532025-01-29T07:09:55.367ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17542025-01-29T07:09:55.367ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
17552025-01-29T07:09:55.367ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
17562025-01-29T07:09:55.378ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17572025-01-29T07:09:55.378ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db2b1192-66c6-4615-a94b-80071566494f
17582025-01-29T07:09:55.398ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17592025-01-29T07:09:55.398ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd
17602025-01-29T07:09:55.421ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17612025-01-29T07:09:55.421ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe
17622025-01-29T07:09:55.443ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17632025-01-29T07:09:55.443ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13
17642025-01-29T07:09:55.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17652025-01-29T07:09:55.463ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c196feef-7346-4e4f-b19c-8b3b0708c867
17662025-01-29T07:09:55.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17672025-01-29T07:09:55.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2
17682025-01-29T07:09:55.505ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17692025-01-29T07:09:55.505ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2
17702025-01-29T07:09:55.526ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17712025-01-29T07:09:55.526ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_99311bbe-9041-4ee9-9e49-88d0748815df
17722025-01-29T07:09:55.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17732025-01-29T07:09:55.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_726f1df1-097f-4118-903d-7cffb2ec5c36
17742025-01-29T07:09:55.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61665 req_id = 7a244126-a4b9-4009-9f72-b7d8ce07f9e7 response_code = 200 uri = /inventory
17752025-01-29T07:09:56.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39165
17762025-01-29T07:09:56.303ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17772025-01-29T07:09:56.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17782025-01-29T07:09:56.303ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17792025-01-29T07:09:56.304ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17802025-01-29T07:09:56.304ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17812025-01-29T07:09:56.304ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17822025-01-29T07:09:56.304ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17832025-01-29T07:09:56.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39165 req_id = a460fe95-58c4-42db-9902-19134b0746fc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17842025-01-29T07:09:56.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37629
17852025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17862025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17872025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17882025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17892025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17902025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17912025-01-29T07:09:56.602ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922025-01-29T07:09:56.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37629 req_id = 9ca82e5f-d079-494e-8b9f-830b53dfc8c1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17932025-01-29T07:09:56.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41476
17942025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17952025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17962025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17972025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17982025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17992025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18002025-01-29T07:09:56.734ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012025-01-29T07:09:56.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41476 req_id = 83377e8a-0539-4d84-b046-b8cc91e0d7b9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18022025-01-29T07:10:00.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56196
18032025-01-29T07:10:00.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56196 req_id = e645e745-b151-421e-8d6a-beea6657ecec response_code = 200 uri = /vpc-routes
18042025-01-29T07:10:00.643ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18052025-01-29T07:10:00.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56196 req_id = 2bea622f-70e5-4052-91ff-9b08222e023f response_code = 204 uri = /eip-gateways
18062025-01-29T07:10:00.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5661 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56196 req_id = b8bd598f-388f-4f8a-9bb0-06535eb97ae7 response_code = 204 uri = /vpc-routes
18072025-01-29T07:10:01.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47486
18082025-01-29T07:10:01.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47486 req_id = 6813a991-b153-48b4-bd90-b2dba84ebc6c response_code = 200 uri = /vpc-routes
18092025-01-29T07:10:01.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54103
18102025-01-29T07:10:01.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54103 req_id = 8c101606-cb1d-4456-9cec-be842d43be04 response_code = 200 uri = /vpc-routes
18112025-01-29T07:10:01.700ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18122025-01-29T07:10:01.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47486 req_id = 65a3bbd0-ec9e-4ba6-8b4b-6624e6280db2 response_code = 204 uri = /eip-gateways
18132025-01-29T07:10:01.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18142025-01-29T07:10:01.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54103 req_id = 5b01085e-1399-4ad0-96eb-bb6db0db29cf response_code = 204 uri = /eip-gateways
18152025-01-29T07:10:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54103 req_id = 7ba09c19-19a5-464a-95f0-71ac1c378260 response_code = 204 uri = /vpc-routes
18162025-01-29T07:10:01.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45468
18172025-01-29T07:10:01.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45468 req_id = f513a192-6af0-4849-97fe-465359b0371b response_code = 200 uri = /vpc-routes
18182025-01-29T07:10:01.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43645
18192025-01-29T07:10:01.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43645 req_id = a89d92bf-7a22-4348-ba14-79626a552283 response_code = 200 uri = /v2p
18202025-01-29T07:10:01.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47486 req_id = e26d2f64-eb79-4f91-adfc-b79453d26251 response_code = 204 uri = /vpc-routes
18212025-01-29T07:10:01.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55412
18222025-01-29T07:10:01.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18232025-01-29T07:10:01.969ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18242025-01-29T07:10:02.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160054 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55412 req_id = 80c2d640-9dc7-4431-ac5c-ab136e5340e8 response_code = 204 uri = /switch-ports
18252025-01-29T07:10:02.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65447
18262025-01-29T07:10:02.042ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18272025-01-29T07:10:02.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45468 req_id = 58e66ff6-5f96-4d10-9d18-433c324243f6 response_code = 204 uri = /eip-gateways
18282025-01-29T07:10:02.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45144
18292025-01-29T07:10:02.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45143
18302025-01-29T07:10:02.042ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18312025-01-29T07:10:02.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55412 req_id = e01d386c-ad3e-4a8c-b5a6-a6c47ce87fe5 response_code = 200 uri = /network-bootstore-config
18322025-01-29T07:10:02.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6554 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45143 req_id = ca32bebc-858c-4153-b894-08524d9d3a72 response_code = 200 uri = /v2p
18332025-01-29T07:10:02.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45468 req_id = 468023bc-2b39-4594-8082-e25395eb1329 response_code = 204 uri = /vpc-routes
18342025-01-29T07:10:02.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58641
18352025-01-29T07:10:02.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58641 req_id = fb5d38ea-a75f-4b13-8fd3-9a90becee80c response_code = 200 uri = /v2p
18362025-01-29T07:10:02.085ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
18372025-01-29T07:10:02.086ZINFOSledAgent (bootstore): Writing ledger to /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18382025-01-29T07:10:02.087ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
18392025-01-29T07:10:02.088ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
18402025-01-29T07:10:02.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5949 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55412 req_id = 80d283e5-0b88-411f-9a21-2368709192ed response_code = 204 uri = /network-bootstore-config
18412025-01-29T07:10:02.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18422025-01-29T07:10:02.161ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18432025-01-29T07:10:02.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65447 req_id = 42f3ec87-22d8-4181-b4f0-7c0f614de078 response_code = 204 uri = /switch-ports
18442025-01-29T07:10:02.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 756 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65447 req_id = ace91fff-3c6f-4607-a0a5-4902f5b0def1 response_code = 200 uri = /network-bootstore-config
18452025-01-29T07:10:02.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18462025-01-29T07:10:02.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45144 req_id = 6a521e8b-aa2b-47c3-ad4d-dec193d313c4 response_code = 204 uri = /switch-ports
18472025-01-29T07:10:02.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45144 req_id = 28266cf7-b8bf-4515-9743-75bd3cfb1722 response_code = 200 uri = /network-bootstore-config
18482025-01-29T07:10:10.724ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45801
18492025-01-29T07:10:10.725ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45801 req_id = 327436f7-6fc0-4f09-b592-52941057e837 response_code = 200 uri = /baseboard
18502025-01-29T07:10:11.004ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:56462 remote_addr = [fd00:1122:3344:101::d]:54365 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
18512025-01-29T07:10:11.039ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34069 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = fbd80e1c-02cd-49d8-85e4-3e7c0ef4cdb9 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
18522025-01-29T07:10:31.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46531
18532025-01-29T07:10:31.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46531 req_id = 4e041316-c130-4133-b8ca-bc09393b5f4c response_code = 200 uri = /vpc-routes
18542025-01-29T07:10:31.680ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18552025-01-29T07:10:31.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46531 req_id = a1cc1c6c-725f-4ca0-a0a7-a51108077838 response_code = 204 uri = /eip-gateways
18562025-01-29T07:10:31.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46531 req_id = ad5937c6-565f-4aa0-818c-3bcd4ead21b4 response_code = 204 uri = /vpc-routes
18572025-01-29T07:10:31.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42173
18582025-01-29T07:10:31.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42173 req_id = bcf826ab-91cf-446b-b5da-f68516c29912 response_code = 200 uri = /vpc-routes
18592025-01-29T07:10:31.771ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18602025-01-29T07:10:31.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42173 req_id = 4f7557ce-78d7-42e6-93fe-6a47f0d66846 response_code = 204 uri = /eip-gateways
18612025-01-29T07:10:31.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42173 req_id = f7c94c58-fb93-4365-b29b-2b50a8c8cc2d response_code = 204 uri = /vpc-routes
18622025-01-29T07:10:31.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46556
18632025-01-29T07:10:31.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46556 req_id = df48fba5-7181-4cd4-af6b-9c9e0ec865bf response_code = 200 uri = /v2p
18642025-01-29T07:10:31.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53238
18652025-01-29T07:10:31.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53238 req_id = 7d229247-40b7-4cec-b862-084e72d033de response_code = 200 uri = /vpc-routes
18662025-01-29T07:10:31.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38461
18672025-01-29T07:10:31.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38461 req_id = 6b26f517-f2c8-4f41-ab32-563ed124eb99 response_code = 200 uri = /v2p
18682025-01-29T07:10:31.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63566
18692025-01-29T07:10:31.901ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18702025-01-29T07:10:31.942ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18712025-01-29T07:10:32.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63566 req_id = 81907786-8ee7-42ed-99a2-a61e56a2f9d1 response_code = 204 uri = /switch-ports
18722025-01-29T07:10:32.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18732025-01-29T07:10:32.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61805
18742025-01-29T07:10:32.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53238 req_id = d0cd196a-c6a4-43fb-8718-ed805a09310f response_code = 204 uri = /eip-gateways
18752025-01-29T07:10:32.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63566 req_id = 66e802e4-df16-41ec-bcb1-4420847c53f0 response_code = 200 uri = /network-bootstore-config
18762025-01-29T07:10:32.001ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18772025-01-29T07:10:32.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50437
18782025-01-29T07:10:32.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50437 req_id = 07898822-1032-4ec0-9943-a40c85e8fcaa response_code = 200 uri = /v2p
18792025-01-29T07:10:32.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53238 req_id = 02280892-2683-48d8-bb43-b6300c3f7f1c response_code = 204 uri = /vpc-routes
18802025-01-29T07:10:32.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18812025-01-29T07:10:32.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43965
18822025-01-29T07:10:32.100ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18832025-01-29T07:10:32.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61805 req_id = 05a6c29e-5c3c-46f4-9260-fe812de1239c response_code = 204 uri = /switch-ports
18842025-01-29T07:10:32.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61805 req_id = 3a83cc7f-0a65-4f50-a5f0-3fdeb548b76f response_code = 200 uri = /network-bootstore-config
18852025-01-29T07:10:32.136ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18862025-01-29T07:10:32.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43965 req_id = 69781ea6-d115-41f8-ad06-932e7cdc3080 response_code = 204 uri = /switch-ports
18872025-01-29T07:10:32.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43965 req_id = 0dc20d40-14e4-45d8-b156-cba8bf6b9ef9 response_code = 200 uri = /network-bootstore-config
18882025-01-29T07:10:40.760ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38641
18892025-01-29T07:10:40.760ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38641 req_id = 00d05ec0-84fb-4f71-b392-69b2395bed6b response_code = 200 uri = /baseboard
18902025-01-29T07:10:41.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7900 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 086fb15b-9c5c-414f-a980-3257aa518d36 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
18912025-01-29T07:11:01.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38560
18922025-01-29T07:11:01.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38560 req_id = 4b925874-8df7-4f95-9c4d-c6e6a48d0bdf response_code = 200 uri = /vpc-routes
18932025-01-29T07:11:01.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46821
18942025-01-29T07:11:01.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46821 req_id = 323ae292-2afd-48e3-b32d-1cb94fea1755 response_code = 200 uri = /vpc-routes
18952025-01-29T07:11:01.621ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18962025-01-29T07:11:01.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38560 req_id = 7f5e418f-225c-4d34-a7c6-c99e9899bb04 response_code = 204 uri = /eip-gateways
18972025-01-29T07:11:01.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
18982025-01-29T07:11:01.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46821 req_id = 3193e306-b986-4da2-97e8-f91514c507e7 response_code = 204 uri = /eip-gateways
18992025-01-29T07:11:01.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38560 req_id = d081ea32-73ee-4948-ba6b-49e0978b0299 response_code = 204 uri = /vpc-routes
19002025-01-29T07:11:01.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46821 req_id = 7650d5d4-9da6-434e-becf-13c03dbf9924 response_code = 204 uri = /vpc-routes
19012025-01-29T07:11:01.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58159
19022025-01-29T07:11:01.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19032025-01-29T07:11:01.697ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19042025-01-29T07:11:01.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113427 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58159 req_id = 24b200a4-dfd8-4288-b421-7a50374b2051 response_code = 204 uri = /switch-ports
19052025-01-29T07:11:01.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42370
19062025-01-29T07:11:01.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58159 req_id = 60fce42f-f5c7-4a76-9a58-42df7bf963da response_code = 200 uri = /network-bootstore-config
19072025-01-29T07:11:01.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42370 req_id = d4f5bdd9-f643-4e9a-bd03-5995499c4f17 response_code = 200 uri = /vpc-routes
19082025-01-29T07:11:01.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47411
19092025-01-29T07:11:01.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47411 req_id = f00f47d9-119f-4937-85c4-3fde9f3c7834 response_code = 200 uri = /v2p
19102025-01-29T07:11:01.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41992
19112025-01-29T07:11:01.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19122025-01-29T07:11:01.829ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19132025-01-29T07:11:01.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41992 req_id = 50e1ba69-413b-4922-97d1-6120b80513b7 response_code = 204 uri = /switch-ports
19142025-01-29T07:11:01.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52877
19152025-01-29T07:11:01.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41992 req_id = 82a2f857-464f-4689-8b8d-1c06d4067f0f response_code = 200 uri = /network-bootstore-config
19162025-01-29T07:11:01.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52877 req_id = a82122da-206a-4c45-af5f-31efb2f8f99a response_code = 200 uri = /v2p
19172025-01-29T07:11:01.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52088
19182025-01-29T07:11:01.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52088 req_id = 88b878f0-75e4-4a56-b6e1-f536872b287f response_code = 200 uri = /v2p
19192025-01-29T07:11:01.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19202025-01-29T07:11:01.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42370 req_id = d645721a-9d41-4417-a3cf-d06dab9d69d2 response_code = 204 uri = /eip-gateways
19212025-01-29T07:11:02.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 371 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42370 req_id = 7a3972c8-94c4-4945-a992-c0ef690a4727 response_code = 204 uri = /vpc-routes
19222025-01-29T07:11:02.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47877
19232025-01-29T07:11:02.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19242025-01-29T07:11:02.070ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19252025-01-29T07:11:02.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47877 req_id = 1017ada6-3cfe-4789-88fc-b9f4ca85a3aa response_code = 204 uri = /switch-ports
19262025-01-29T07:11:02.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47877 req_id = 584dacb0-8737-4b3f-bb44-8f0f69592585 response_code = 200 uri = /network-bootstore-config
19272025-01-29T07:11:10.792ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53451
19282025-01-29T07:11:10.793ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53451 req_id = 5e76fc3e-515c-4575-8a2d-6ea36a75fc88 response_code = 200 uri = /baseboard
19292025-01-29T07:11:11.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8141 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 6ba04de1-fe1e-4031-9c07-1a6857b06651 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
19302025-01-29T07:11:31.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49623
19312025-01-29T07:11:31.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49623 req_id = 2aff881d-f20b-4b09-b0a5-64056845291c response_code = 200 uri = /vpc-routes
19322025-01-29T07:11:31.755ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19332025-01-29T07:11:31.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49623 req_id = a53ebb6c-b296-403d-b663-dce88f1eee93 response_code = 204 uri = /eip-gateways
19342025-01-29T07:11:31.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49623 req_id = ded72a92-4729-44f1-bd04-caf4727a75e8 response_code = 204 uri = /vpc-routes
19352025-01-29T07:11:31.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34643
19362025-01-29T07:11:31.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34643 req_id = 686dbfc9-5558-44e9-b110-b89b7df92b04 response_code = 200 uri = /vpc-routes
19372025-01-29T07:11:31.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19382025-01-29T07:11:31.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34643 req_id = 8c6a945f-7cf0-431c-a1b6-88030293253a response_code = 204 uri = /eip-gateways
19392025-01-29T07:11:31.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34643 req_id = b0c81881-8968-4c0d-8cc3-8fba4aca8ce7 response_code = 204 uri = /vpc-routes
19402025-01-29T07:11:31.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38382
19412025-01-29T07:11:31.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38382 req_id = 34a64e78-f0b1-40db-a849-7e40125fce93 response_code = 200 uri = /vpc-routes
19422025-01-29T07:11:31.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39673
19432025-01-29T07:11:31.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39673 req_id = 65c06be7-d5e0-4126-9afe-786e32f6e4a7 response_code = 200 uri = /v2p
19442025-01-29T07:11:31.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62892
19452025-01-29T07:11:31.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62892 req_id = 637348c4-87e3-4fac-8a15-34027b4f9472 response_code = 200 uri = /v2p
19462025-01-29T07:11:31.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56249
19472025-01-29T07:11:31.955ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19482025-01-29T07:11:31.993ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19492025-01-29T07:11:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56249 req_id = 063cfc01-df65-4e60-bc4e-10d188b4284f response_code = 204 uri = /switch-ports
19502025-01-29T07:11:32.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58816
19512025-01-29T07:11:32.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19522025-01-29T07:11:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38382 req_id = 85652cde-e53f-408c-9872-d06580f9a4af response_code = 204 uri = /eip-gateways
19532025-01-29T07:11:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56249 req_id = 7836a7d2-087b-4430-94b2-0fd0a66ffedc response_code = 200 uri = /network-bootstore-config
19542025-01-29T07:11:32.051ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19552025-01-29T07:11:32.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38382 req_id = f713e27d-95db-4e2c-bea2-e15cf16e0a92 response_code = 204 uri = /vpc-routes
19562025-01-29T07:11:32.088ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19572025-01-29T07:11:32.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63121
19582025-01-29T07:11:32.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63121 req_id = 87f14723-0f2b-49cf-8479-0da6b916a0f7 response_code = 200 uri = /v2p
19592025-01-29T07:11:32.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58816 req_id = a53e9d0e-e0a1-4990-a9fe-2b0c8416204d response_code = 204 uri = /switch-ports
19602025-01-29T07:11:32.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58816 req_id = 0ab5a57a-03ce-4949-b256-de8d2a6c2e06 response_code = 200 uri = /network-bootstore-config
19612025-01-29T07:11:32.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35843
19622025-01-29T07:11:32.179ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19632025-01-29T07:11:32.216ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19642025-01-29T07:11:32.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91581 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35843 req_id = 5e682c1a-0070-4153-a8c8-57a1690af297 response_code = 204 uri = /switch-ports
19652025-01-29T07:11:32.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35843 req_id = 9db2b8cb-714f-422c-92de-165b0fa2efff response_code = 200 uri = /network-bootstore-config
19662025-01-29T07:11:40.827ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54649
19672025-01-29T07:11:40.827ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54649 req_id = 242729d4-6127-4b1a-9e76-14f4912ce917 response_code = 200 uri = /baseboard
19682025-01-29T07:11:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6913 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 9a75e758-0cdd-487d-9162-9a5c5830c1a3 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
19692025-01-29T07:12:01.478ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33459
19702025-01-29T07:12:01.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33459 req_id = 7ad6180b-4d74-48db-893e-669fdc4122d7 response_code = 200 uri = /vpc-routes
19712025-01-29T07:12:01.532ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46102
19722025-01-29T07:12:01.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46102 req_id = 6d0befeb-e789-4ada-a74e-d2cae88a66b9 response_code = 200 uri = /vpc-routes
19732025-01-29T07:12:01.540ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19742025-01-29T07:12:01.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33459 req_id = 4f9c2f3c-61c8-49ed-b3dc-e8c1b466b127 response_code = 204 uri = /eip-gateways
19752025-01-29T07:12:01.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33459 req_id = 3c3974f6-c2e3-4a6d-9887-45a0545db681 response_code = 204 uri = /vpc-routes
19762025-01-29T07:12:01.622ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19772025-01-29T07:12:01.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46102 req_id = f2ca7044-09c9-48f9-9591-54d688d24274 response_code = 204 uri = /eip-gateways
19782025-01-29T07:12:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46102 req_id = ac17babc-3b34-4be0-ae3b-4cc9fd236080 response_code = 204 uri = /vpc-routes
19792025-01-29T07:12:01.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50007
19802025-01-29T07:12:01.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19812025-01-29T07:12:01.688ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19822025-01-29T07:12:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112507 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50007 req_id = 74a478fe-366c-40d2-aab7-84ddb69386e3 response_code = 204 uri = /switch-ports
19832025-01-29T07:12:01.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46235
19842025-01-29T07:12:01.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54291
19852025-01-29T07:12:01.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61713
19862025-01-29T07:12:01.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19872025-01-29T07:12:01.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46235 req_id = 8dbb88f2-6b18-44df-918b-ade7ddc91a2f response_code = 200 uri = /v2p
19882025-01-29T07:12:01.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54291 req_id = cec3672b-19bb-4034-b3dc-3354d6a3513c response_code = 200 uri = /vpc-routes
19892025-01-29T07:12:01.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 931 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50007 req_id = 3f793456-980e-4c9d-93be-09fedd7d34f0 response_code = 200 uri = /network-bootstore-config
19902025-01-29T07:12:01.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51266
19912025-01-29T07:12:01.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51266 req_id = 1919e232-1bf6-4f0a-a791-34c79406b5c6 response_code = 200 uri = /v2p
19922025-01-29T07:12:01.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19932025-01-29T07:12:01.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
19942025-01-29T07:12:01.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54291 req_id = 6358e73a-88d7-43cf-888b-e0491e10113d response_code = 204 uri = /eip-gateways
19952025-01-29T07:12:01.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49002
19962025-01-29T07:12:01.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49002 req_id = 82b551aa-5c70-4b2c-af40-e8da1300b25c response_code = 200 uri = /v2p
19972025-01-29T07:12:01.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54291 req_id = a0bfb35e-0f70-493f-b2f3-c3888d9405fc response_code = 204 uri = /vpc-routes
19982025-01-29T07:12:01.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51766
19992025-01-29T07:12:01.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20002025-01-29T07:12:01.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61713 req_id = c9bf446f-cce3-4ed6-9808-0783d769bb29 response_code = 204 uri = /switch-ports
20012025-01-29T07:12:01.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61713 req_id = 7fbbcd2c-a567-4a7b-8171-9be50069df08 response_code = 200 uri = /network-bootstore-config
20022025-01-29T07:12:01.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20032025-01-29T07:12:01.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121833 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51766 req_id = 43dd42f8-da81-4f9a-8395-d5cb586db6d7 response_code = 204 uri = /switch-ports
20042025-01-29T07:12:01.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51766 req_id = 509e976f-342b-4fce-ad97-3781a1996c31 response_code = 200 uri = /network-bootstore-config
20052025-01-29T07:12:10.862ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40553
20062025-01-29T07:12:10.862ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40553 req_id = 7f1da836-ea5f-4e9d-8d29-8d5f86a2547d response_code = 200 uri = /baseboard
20072025-01-29T07:12:11.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7515 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 5420d285-9aab-484b-a745-abc166cd7605 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
20082025-01-29T07:12:23.838ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20092025-01-29T07:12:31.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43723
20102025-01-29T07:12:31.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43723 req_id = 96875d2b-55cf-4abb-9f5a-495c0e64b988 response_code = 200 uri = /vpc-routes
20112025-01-29T07:12:31.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54201
20122025-01-29T07:12:31.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54201 req_id = 7986b168-0121-4c2e-afad-d9435dc4e7dd response_code = 200 uri = /vpc-routes
20132025-01-29T07:12:31.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20142025-01-29T07:12:31.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43723 req_id = 585f9d10-75fe-4988-86ae-7ca32f75a7a1 response_code = 204 uri = /eip-gateways
20152025-01-29T07:12:31.762ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20162025-01-29T07:12:31.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54201 req_id = 3b1ce459-bac0-4346-b0ee-d9b0a18d09fe response_code = 204 uri = /eip-gateways
20172025-01-29T07:12:31.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54201 req_id = 80bcac20-fcd1-4617-aeec-b296907354f7 response_code = 204 uri = /vpc-routes
20182025-01-29T07:12:31.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36681
20192025-01-29T07:12:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36681 req_id = 5077f390-5893-4f7c-a03d-d876eb06c4c5 response_code = 200 uri = /v2p
20202025-01-29T07:12:31.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34360
20212025-01-29T07:12:31.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34360 req_id = 98816713-84ec-4832-ad78-bb839e9cee3d response_code = 200 uri = /v2p
20222025-01-29T07:12:31.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43723 req_id = d2d70e82-ffc5-41dc-afb9-08a358ae7495 response_code = 204 uri = /vpc-routes
20232025-01-29T07:12:31.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40925
20242025-01-29T07:12:31.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20252025-01-29T07:12:31.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20262025-01-29T07:12:31.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40925 req_id = 7c8bc472-10fd-4153-8316-e5aff5fd7597 response_code = 204 uri = /switch-ports
20272025-01-29T07:12:31.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59485
20282025-01-29T07:12:31.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56944
20292025-01-29T07:12:31.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49156
20302025-01-29T07:12:31.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40925 req_id = bc1cabaf-439c-4b59-a5f4-057a32680fd5 response_code = 200 uri = /network-bootstore-config
20312025-01-29T07:12:31.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59485 req_id = e6060eb1-928b-448c-8326-e6c0e499b089 response_code = 200 uri = /vpc-routes
20322025-01-29T07:12:31.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49156 req_id = c992b4a1-2e00-4c04-aa92-6f5fd4f34c4b response_code = 200 uri = /v2p
20332025-01-29T07:12:31.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20342025-01-29T07:12:31.982ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43546
20352025-01-29T07:12:31.991ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20362025-01-29T07:12:31.995ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20372025-01-29T07:12:31.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59485 req_id = b4fa16f9-48bb-447c-a19f-c3106e3360e9 response_code = 204 uri = /eip-gateways
20382025-01-29T07:12:32.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59485 req_id = 1b3bfad2-18e0-44c2-9094-6bd015a81326 response_code = 204 uri = /vpc-routes
20392025-01-29T07:12:32.061ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20402025-01-29T07:12:32.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112200 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56944 req_id = e8048681-19b9-48c0-aa2c-5b3467dd6ee3 response_code = 204 uri = /switch-ports
20412025-01-29T07:12:32.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56944 req_id = 39eff9de-9d57-40dd-8b38-9da4ae1aac5f response_code = 200 uri = /network-bootstore-config
20422025-01-29T07:12:32.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20432025-01-29T07:12:32.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43546 req_id = 2b207873-206f-4b25-b247-8e2d5b294fac response_code = 204 uri = /switch-ports
20442025-01-29T07:12:32.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43546 req_id = 3a2a132f-2f01-43eb-8144-4b553f75a120 response_code = 200 uri = /network-bootstore-config
20452025-01-29T07:12:40.893ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47112
20462025-01-29T07:12:40.894ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47112 req_id = b9b02b96-8c03-445c-ab97-6a4494872a26 response_code = 200 uri = /baseboard
20472025-01-29T07:12:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7608 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = ae3f35f4-a734-4d64-b948-8c642252506f response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
20482025-01-29T07:13:01.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48993
20492025-01-29T07:13:01.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48993 req_id = a5469b84-c7b2-4ef1-beab-72b69215a8e2 response_code = 200 uri = /vpc-routes
20502025-01-29T07:13:01.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65530
20512025-01-29T07:13:01.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65530 req_id = 2b02426f-b517-41d7-84d6-f6ccb1fff2ab response_code = 200 uri = /v2p
20522025-01-29T07:13:01.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20532025-01-29T07:13:01.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48993 req_id = 5aa8d131-af8e-46b5-93bf-7af62bdd7b5d response_code = 204 uri = /eip-gateways
20542025-01-29T07:13:01.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48993 req_id = 9f65eea6-5bf0-44c3-b62c-c919f213da72 response_code = 204 uri = /vpc-routes
20552025-01-29T07:13:01.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46552
20562025-01-29T07:13:01.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46552 req_id = a1b321dd-5f4e-4add-9428-b9de5db6aaa4 response_code = 200 uri = /vpc-routes
20572025-01-29T07:13:01.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50269
20582025-01-29T07:13:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50269 req_id = ebec0c24-d252-48be-bbde-6917abcdddbf response_code = 200 uri = /vpc-routes
20592025-01-29T07:13:01.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40729
20602025-01-29T07:13:01.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20612025-01-29T07:13:01.702ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20622025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40729 req_id = 2628e1e6-09b9-4d19-9489-0e1455e83a26 response_code = 204 uri = /switch-ports
20632025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52195
20642025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40542
20652025-01-29T07:13:01.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20662025-01-29T07:13:01.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20672025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46552 req_id = c0af05b7-d299-43bd-b6e6-0143399613a0 response_code = 204 uri = /eip-gateways
20682025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50269 req_id = eb7db284-22a5-425e-abae-594e2f82493d response_code = 204 uri = /eip-gateways
20692025-01-29T07:13:01.760ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20702025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40542 req_id = d70d6600-fc06-4e76-a8d5-c590155ecd23 response_code = 200 uri = /v2p
20712025-01-29T07:13:01.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 409 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40729 req_id = 01ae9124-17f3-43ee-a2c9-6f155f4530fe response_code = 200 uri = /network-bootstore-config
20722025-01-29T07:13:01.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46552 req_id = 4a76fc9c-d835-466e-a16c-5e057c1ce1fd response_code = 204 uri = /vpc-routes
20732025-01-29T07:13:01.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50269 req_id = 43bf7115-c9f3-4a32-878e-8b469980231a response_code = 204 uri = /vpc-routes
20742025-01-29T07:13:01.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46707
20752025-01-29T07:13:01.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46707 req_id = 9958d068-c36c-46d2-a079-3be0514245b7 response_code = 200 uri = /v2p
20762025-01-29T07:13:01.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20772025-01-29T07:13:01.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54133
20782025-01-29T07:13:01.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20792025-01-29T07:13:01.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52195 req_id = ffd2786b-1679-430a-9e01-f11bfd6efaca response_code = 204 uri = /switch-ports
20802025-01-29T07:13:01.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 618 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52195 req_id = 5415a0f0-7fcf-42a5-a863-3d0f0dbf1979 response_code = 200 uri = /network-bootstore-config
20812025-01-29T07:13:01.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20822025-01-29T07:13:01.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128102 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54133 req_id = 0d2c141c-75a3-405c-8051-5427f478c305 response_code = 204 uri = /switch-ports
20832025-01-29T07:13:01.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54133 req_id = 39e3fc0b-c92b-4cbb-96a8-535500a71e5d response_code = 200 uri = /network-bootstore-config
20842025-01-29T07:13:10.935ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51888
20852025-01-29T07:13:10.935ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51888 req_id = 5ff56420-5543-4751-acfe-b178e79b9d78 response_code = 200 uri = /baseboard
20862025-01-29T07:13:11.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7044 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 8834cddf-b19c-4228-ba37-bb72274cd361 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
20872025-01-29T07:13:31.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55071
20882025-01-29T07:13:31.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50752
20892025-01-29T07:13:31.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50752 req_id = a5fce07d-2e5e-47cc-b2ab-8402f70b83c5 response_code = 200 uri = /vpc-routes
20902025-01-29T07:13:31.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55071 req_id = aefa06af-f182-4c6f-bee6-c4c17f014222 response_code = 200 uri = /vpc-routes
20912025-01-29T07:13:31.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20922025-01-29T07:13:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50752 req_id = 1563d80f-67fe-4636-b493-e2c79a921404 response_code = 204 uri = /eip-gateways
20932025-01-29T07:13:31.685ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
20942025-01-29T07:13:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55071 req_id = 5d8dbe02-af01-4bd0-ba24-0e896b285434 response_code = 204 uri = /eip-gateways
20952025-01-29T07:13:31.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55071 req_id = c8bd00de-d465-42b7-ae87-931c1410c310 response_code = 204 uri = /vpc-routes
20962025-01-29T07:13:31.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50752 req_id = 41a41600-497d-40f2-80e9-ed32c78b3735 response_code = 204 uri = /vpc-routes
20972025-01-29T07:13:31.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43645
20982025-01-29T07:13:31.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43645 req_id = 8949ca60-344d-4eb2-9e0e-733372dce529 response_code = 200 uri = /v2p
20992025-01-29T07:13:31.815ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62074
21002025-01-29T07:13:31.815ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21012025-01-29T07:13:31.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21022025-01-29T07:13:31.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62074 req_id = ae7341f3-d09c-4156-b589-840e31fd4369 response_code = 204 uri = /switch-ports
21032025-01-29T07:13:31.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49551
21042025-01-29T07:13:31.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40771
21052025-01-29T07:13:31.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62074 req_id = e0f0724f-19df-4f6f-b875-aa28c756ed4d response_code = 200 uri = /network-bootstore-config
21062025-01-29T07:13:31.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40771 req_id = 18b89e0a-9c38-4ba6-8232-031d818b8ec1 response_code = 200 uri = /v2p
21072025-01-29T07:13:31.913ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21082025-01-29T07:13:31.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21092025-01-29T07:13:31.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47540
21102025-01-29T07:13:31.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47540 req_id = 1103c8c2-365f-4aee-a2df-6bafea3ed1f5 response_code = 200 uri = /vpc-routes
21112025-01-29T07:13:31.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38141
21122025-01-29T07:13:31.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38141 req_id = cb0805bd-f960-4752-9725-4b9b13d12403 response_code = 200 uri = /v2p
21132025-01-29T07:13:31.968ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21142025-01-29T07:13:31.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47540 req_id = 3a6c9c65-72bf-4c81-8791-4ad6a004cebe response_code = 204 uri = /eip-gateways
21152025-01-29T07:13:31.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47540 req_id = 3b0ba172-f9cb-45e1-aed4-73ab9761e4ac response_code = 204 uri = /vpc-routes
21162025-01-29T07:13:32.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49551 req_id = d4704e5d-e417-45ca-96c8-6aee715c9db9 response_code = 204 uri = /switch-ports
21172025-01-29T07:13:32.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49551 req_id = 5757e006-ce23-4b17-889a-11c83857f68c response_code = 200 uri = /network-bootstore-config
21182025-01-29T07:13:32.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42317
21192025-01-29T07:13:32.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21202025-01-29T07:13:32.066ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21212025-01-29T07:13:32.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42317 req_id = 9b140b33-0226-441d-9cb6-542f73352519 response_code = 204 uri = /switch-ports
21222025-01-29T07:13:32.121ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42317 req_id = 78822488-7fe4-4cf2-a117-33467a0dc6d4 response_code = 200 uri = /network-bootstore-config
21232025-01-29T07:13:40.968ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64726
21242025-01-29T07:13:40.968ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64726 req_id = 13eebcb3-32c2-4c8f-90e0-33125a12c840 response_code = 200 uri = /baseboard
21252025-01-29T07:13:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6789 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 4b05e310-eee8-44af-a6f9-21735cd35c78 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
21262025-01-29T07:14:01.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36849
21272025-01-29T07:14:01.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36849 req_id = f54544dc-2c27-4902-bf0a-edae8be24918 response_code = 200 uri = /vpc-routes
21282025-01-29T07:14:01.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53431
21292025-01-29T07:14:01.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53431 req_id = c7b7a3fb-a188-4d17-a3bb-08c28cdb29db response_code = 200 uri = /vpc-routes
21302025-01-29T07:14:01.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21312025-01-29T07:14:01.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36849 req_id = 0d490444-9947-4247-be4b-57d63010147c response_code = 204 uri = /eip-gateways
21322025-01-29T07:14:01.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36849 req_id = a6600be2-ebed-4938-9024-72165f90297f response_code = 204 uri = /vpc-routes
21332025-01-29T07:14:01.602ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21342025-01-29T07:14:01.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53431 req_id = 36f7a761-5ad8-4b75-8ee0-60d2d0ef45ca response_code = 204 uri = /eip-gateways
21352025-01-29T07:14:01.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53431 req_id = a5e7c5f6-7521-4e97-89bc-7e114ee8e59d response_code = 204 uri = /vpc-routes
21362025-01-29T07:14:01.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33366
21372025-01-29T07:14:01.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21382025-01-29T07:14:01.676ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21392025-01-29T07:14:01.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33366 req_id = eb9be025-1010-4780-a1f5-7bea654b282c response_code = 204 uri = /switch-ports
21402025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60572
21412025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42704
21422025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39270
21432025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33366 req_id = 2a66e1a8-9365-46f9-8060-a3e76fa5c47e response_code = 200 uri = /network-bootstore-config
21442025-01-29T07:14:01.739ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21452025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60572 req_id = 5ac67386-36fa-4f64-88cb-c5f7b6dc09a5 response_code = 200 uri = /v2p
21462025-01-29T07:14:01.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42704 req_id = ed825287-3f09-4948-91ca-516acc6752c2 response_code = 200 uri = /v2p
21472025-01-29T07:14:01.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63743
21482025-01-29T07:14:01.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63743 req_id = e5c16f42-08e9-4f82-ba44-06c9a1e6b2bb response_code = 200 uri = /vpc-routes
21492025-01-29T07:14:01.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21502025-01-29T07:14:01.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21512025-01-29T07:14:01.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63743 req_id = d7202716-cf96-4c9c-9d9e-4fcc2f476a3c response_code = 204 uri = /eip-gateways
21522025-01-29T07:14:01.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63743 req_id = 942f1ded-3483-4340-aba2-2869a20a042b response_code = 204 uri = /vpc-routes
21532025-01-29T07:14:01.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39116
21542025-01-29T07:14:01.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21552025-01-29T07:14:01.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39270 req_id = b7ea8a4c-e59b-44dc-8793-a746375bffd9 response_code = 204 uri = /switch-ports
21562025-01-29T07:14:01.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 732 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39270 req_id = 90a41f4f-44d3-4892-a856-aaf3f141eed7 response_code = 200 uri = /network-bootstore-config
21572025-01-29T07:14:01.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45524
21582025-01-29T07:14:01.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45524 req_id = 86c8b7d0-ddda-44d9-9f2c-b7f8e73c9e15 response_code = 200 uri = /v2p
21592025-01-29T07:14:01.878ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21602025-01-29T07:14:01.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39116 req_id = 4ba0cc49-6ae5-467c-84a1-3e993d46b250 response_code = 204 uri = /switch-ports
21612025-01-29T07:14:01.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39116 req_id = c4164781-ca30-4cbd-b0a5-afe8d03f5279 response_code = 200 uri = /network-bootstore-config
21622025-01-29T07:14:11.009ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8966 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 18f58416-5050-4b16-bb1c-14fd66f399bb response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
21632025-01-29T07:14:11.010ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49795
21642025-01-29T07:14:11.010ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49795 req_id = 4d1640a2-02b9-4a6d-b48d-25e80f344071 response_code = 200 uri = /baseboard
21652025-01-29T07:14:31.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57871
21662025-01-29T07:14:31.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57871 req_id = 8413c9d8-0cf8-47f7-92c4-6832277bf857 response_code = 200 uri = /vpc-routes
21672025-01-29T07:14:31.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39040
21682025-01-29T07:14:31.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21692025-01-29T07:14:31.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39040 req_id = b8e63c62-97a7-4c12-8a0b-521d72ea396d response_code = 200 uri = /artifacts
21702025-01-29T07:14:31.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21712025-01-29T07:14:31.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57871 req_id = e91bebdc-f0ac-41cd-a6a2-54f0f7d45790 response_code = 204 uri = /eip-gateways
21722025-01-29T07:14:31.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57871 req_id = f2a35a59-5b2e-4c04-b636-29e1ba21110d response_code = 204 uri = /vpc-routes
21732025-01-29T07:14:31.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59785
21742025-01-29T07:14:31.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59785 req_id = 9bff73ab-81a3-42bd-a448-ad3944f76826 response_code = 200 uri = /vpc-routes
21752025-01-29T07:14:31.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51447
21762025-01-29T07:14:31.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51447 req_id = 7c75fa74-41bd-4183-8394-a01db263a8fc response_code = 200 uri = /vpc-routes
21772025-01-29T07:14:31.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37630
21782025-01-29T07:14:31.899ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21792025-01-29T07:14:31.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37630 req_id = cc7af72c-2ab8-4da0-8f6a-a99114d9d60c response_code = 200 uri = /artifacts
21802025-01-29T07:14:31.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57368
21812025-01-29T07:14:31.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
21822025-01-29T07:14:31.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57368 req_id = 03e40d28-ebd0-425b-b883-7b3883014690 response_code = 200 uri = /artifacts
21832025-01-29T07:14:31.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21842025-01-29T07:14:31.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59785 req_id = bbcc38e4-ab93-43c4-9f68-28012028ec22 response_code = 204 uri = /eip-gateways
21852025-01-29T07:14:31.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
21862025-01-29T07:14:31.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51447 req_id = 5c18c410-dc06-4c78-9da1-6a00cd6b1c05 response_code = 204 uri = /eip-gateways
21872025-01-29T07:14:31.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59785 req_id = 4c258d4f-3210-43c7-a684-6a365ca6eccf response_code = 204 uri = /vpc-routes
21882025-01-29T07:14:31.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51447 req_id = 1e0fdf5c-1149-4e04-bb84-49e2c4575bae response_code = 204 uri = /vpc-routes
21892025-01-29T07:14:31.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56352
21902025-01-29T07:14:31.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21912025-01-29T07:14:32.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21922025-01-29T07:14:32.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56352 req_id = 775f9664-f660-4e8e-8274-6ea62f9d1b94 response_code = 204 uri = /switch-ports
21932025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62724
21942025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35951
21952025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48313
21962025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54418
21972025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43447
21982025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61324
21992025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56352 req_id = 4f9c1370-f2f3-411f-8566-b12315037672 response_code = 200 uri = /network-bootstore-config
22002025-01-29T07:14:32.097ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22012025-01-29T07:14:32.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35951 req_id = 5b5008fb-894d-45f0-9ecd-2a8d1027d48c response_code = 200 uri = /v2p
22022025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22032025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22042025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22052025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22062025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22072025-01-29T07:14:32.101ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22082025-01-29T07:14:32.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4197 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43447 req_id = c647e844-ca57-4e65-80b5-94dbe6e24cd1 response_code = 200 uri = /v2p
22092025-01-29T07:14:32.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62724 req_id = 2a153018-7bd5-41fe-bc84-60cb4014b6d7 response_code = 200 uri = /v2p
22102025-01-29T07:14:32.102ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112025-01-29T07:14:32.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4580 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54418 req_id = 6c3c532a-e238-4756-8555-8871edf6f52c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22122025-01-29T07:14:32.140ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22132025-01-29T07:14:32.198ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22142025-01-29T07:14:32.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61324 req_id = be35323d-0e3e-444c-a03c-f1a99c61c54e response_code = 204 uri = /switch-ports
22152025-01-29T07:14:32.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 738 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61324 req_id = a448b262-af5c-4d89-bd8c-c33b61a26706 response_code = 200 uri = /network-bootstore-config
22162025-01-29T07:14:32.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59453
22172025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22182025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22192025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22202025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22212025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22222025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22232025-01-29T07:14:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22242025-01-29T07:14:32.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59453 req_id = dcdbd559-7cf9-4ff8-be24-af0a816a5793 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22252025-01-29T07:14:32.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22262025-01-29T07:14:32.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194903 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48313 req_id = 8d1d7b54-9e18-4980-8934-71215ffdfec1 response_code = 204 uri = /switch-ports
22272025-01-29T07:14:32.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48313 req_id = 1ebb0792-444f-46cc-b823-7d6305ed97e2 response_code = 200 uri = /network-bootstore-config
22282025-01-29T07:14:32.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63293
22292025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22302025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22312025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22322025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22332025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22342025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22352025-01-29T07:14:32.333ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22362025-01-29T07:14:32.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63293 req_id = f9957416-1c18-4c06-bb31-ea23437124c9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22372025-01-29T07:14:41.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8190 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 93b04b75-12df-4ce8-bf57-01243cbfe0cd response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
22382025-01-29T07:14:41.044ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51034
22392025-01-29T07:14:41.044ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51034 req_id = 25df2c14-3d69-4d03-92f7-b78a6fa2aa7c response_code = 200 uri = /baseboard
22402025-01-29T07:15:01.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60807
22412025-01-29T07:15:01.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60807 req_id = f2e130d9-e2f7-4a60-8c6e-90c1900be531 response_code = 200 uri = /vpc-routes
22422025-01-29T07:15:01.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43937
22432025-01-29T07:15:01.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43937 req_id = f7d4f0e1-4db5-49e6-b5e5-38f07bbfcb61 response_code = 200 uri = /vpc-routes
22442025-01-29T07:15:01.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34574
22452025-01-29T07:15:01.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34574 req_id = 5941decd-f646-49cd-b8ea-972867b1a56a response_code = 200 uri = /v2p
22462025-01-29T07:15:01.635ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22472025-01-29T07:15:01.635ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60807 req_id = a780c9cd-3f3f-4bbb-aa9b-93c0ae2b66ed response_code = 204 uri = /eip-gateways
22482025-01-29T07:15:01.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60807 req_id = 90e01ade-d1f0-49ad-8833-46387c3a1c42 response_code = 204 uri = /vpc-routes
22492025-01-29T07:15:01.667ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22502025-01-29T07:15:01.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43937 req_id = 2e8c0164-6af3-4a32-8415-321b7352fbc7 response_code = 204 uri = /eip-gateways
22512025-01-29T07:15:01.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43937 req_id = 979ce831-a799-420a-9c58-af863711a210 response_code = 204 uri = /vpc-routes
22522025-01-29T07:15:01.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37045
22532025-01-29T07:15:01.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37045 req_id = 44380ab7-c13c-48eb-bb81-91ebf772c9d2 response_code = 200 uri = /vpc-routes
22542025-01-29T07:15:01.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38988
22552025-01-29T07:15:01.729ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22562025-01-29T07:15:01.788ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22572025-01-29T07:15:01.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38988 req_id = eb37bd24-8855-4fbc-bd7d-52ddb5e114c6 response_code = 204 uri = /switch-ports
22582025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52866
22592025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41017
22602025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47774
22612025-01-29T07:15:01.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22622025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37045 req_id = 5ba4946c-3323-45fd-a2f5-fc11b73aa2e7 response_code = 204 uri = /eip-gateways
22632025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41017 req_id = 49c9f7ff-340b-4ba7-a9b5-bbbbd12e29fe response_code = 200 uri = /v2p
22642025-01-29T07:15:01.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22652025-01-29T07:15:01.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 413 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38988 req_id = 8200da8e-944a-4677-a775-6c4bf2f04f01 response_code = 200 uri = /network-bootstore-config
22662025-01-29T07:15:01.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56267
22672025-01-29T07:15:01.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56267 req_id = a1602084-a6ea-4463-944e-29867cb045c2 response_code = 200 uri = /v2p
22682025-01-29T07:15:01.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 985 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37045 req_id = f8324f88-f979-44f8-96d9-da187a9ff594 response_code = 204 uri = /vpc-routes
22692025-01-29T07:15:01.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22702025-01-29T07:15:02.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22712025-01-29T07:15:02.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47774 req_id = 8c9fc718-f86f-44c4-912d-99bff9f008aa response_code = 204 uri = /switch-ports
22722025-01-29T07:15:02.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47774 req_id = 4410e2d0-35cb-4ffd-90b7-19110ca6b2fc response_code = 200 uri = /network-bootstore-config
22732025-01-29T07:15:02.141ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22742025-01-29T07:15:02.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 315064 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52866 req_id = a0aea1c6-e194-4c82-9d06-eaf27e477647 response_code = 204 uri = /switch-ports
22752025-01-29T07:15:02.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52866 req_id = f9d0558e-c983-4bdd-9f22-ea27b5b5264b response_code = 200 uri = /network-bootstore-config
22762025-01-29T07:15:11.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6876 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = b05044ab-0da1-4159-b449-ac4b3cbea002 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
22772025-01-29T07:15:11.078ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51490
22782025-01-29T07:15:11.078ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51490 req_id = 91b43870-d967-4f4f-9f6e-77d4d621fc5e response_code = 200 uri = /baseboard
22792025-01-29T07:15:31.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32879
22802025-01-29T07:15:31.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32879 req_id = 60a631fb-945c-4d81-9ac3-703f286b9b6d response_code = 200 uri = /v2p
22812025-01-29T07:15:31.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48788
22822025-01-29T07:15:31.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48788 req_id = 897d4b23-d349-4e00-8b93-fe4520c7bf06 response_code = 200 uri = /vpc-routes
22832025-01-29T07:15:31.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37253
22842025-01-29T07:15:31.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37253 req_id = 164c1d8a-b082-4515-b31a-727d89a946e3 response_code = 200 uri = /vpc-routes
22852025-01-29T07:15:31.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22862025-01-29T07:15:31.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37253 req_id = 60128b96-5773-4daa-98ae-83871a2ac3c7 response_code = 204 uri = /eip-gateways
22872025-01-29T07:15:31.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37253 req_id = 09665f4e-ef0f-4b54-a104-52f4acaccb7b response_code = 204 uri = /vpc-routes
22882025-01-29T07:15:31.748ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22892025-01-29T07:15:31.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48788 req_id = 844cf9bd-100b-40e4-a4c3-50c1f9846728 response_code = 204 uri = /eip-gateways
22902025-01-29T07:15:31.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48788 req_id = 4a9ebb10-bccc-46b7-8f42-e823001d3c4d response_code = 204 uri = /vpc-routes
22912025-01-29T07:15:31.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62585
22922025-01-29T07:15:31.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62585 req_id = 4213d6b2-483b-4641-ad8b-06ec5feb5b9c response_code = 200 uri = /vpc-routes
22932025-01-29T07:15:31.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45727
22942025-01-29T07:15:31.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22952025-01-29T07:15:31.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22962025-01-29T07:15:31.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45727 req_id = b20331fa-3c05-4ca5-83da-5e1a1cecad4d response_code = 204 uri = /switch-ports
22972025-01-29T07:15:31.954ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64054
22982025-01-29T07:15:31.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
22992025-01-29T07:15:31.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62585 req_id = ebfd5860-2e06-4fa7-90d7-328bf0624fb4 response_code = 204 uri = /eip-gateways
23002025-01-29T07:15:31.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45727 req_id = 225f7598-57eb-4c58-a27e-8c34e2b921b7 response_code = 200 uri = /network-bootstore-config
23012025-01-29T07:15:31.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64054 req_id = e9b9fc11-5b4a-46d4-81a1-33c5f69a1b23 response_code = 200 uri = /v2p
23022025-01-29T07:15:31.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55699
23032025-01-29T07:15:31.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23042025-01-29T07:15:31.995ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23052025-01-29T07:15:32.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84710 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55699 req_id = 1e714c79-4bfd-4f48-ac72-df2b74a0721b response_code = 204 uri = /switch-ports
23062025-01-29T07:15:32.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37374
23072025-01-29T07:15:32.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57505
23082025-01-29T07:15:32.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55699 req_id = 72f5ed3d-f9d1-486b-a088-5b2e8a054934 response_code = 200 uri = /network-bootstore-config
23092025-01-29T07:15:32.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23102025-01-29T07:15:32.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62585 req_id = a9434077-b73a-48ce-a5a1-938d8d6be8cf response_code = 204 uri = /vpc-routes
23112025-01-29T07:15:32.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37374 req_id = 9b100346-28c4-4572-9563-c2dd8a0749d6 response_code = 200 uri = /v2p
23122025-01-29T07:15:32.088ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23132025-01-29T07:15:32.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57505 req_id = 50ddbb5a-2e64-404b-a4c6-f471ea2b1c64 response_code = 204 uri = /switch-ports
23142025-01-29T07:15:32.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57505 req_id = 0c539f6c-6c11-4154-ae06-d8e30ebda6f6 response_code = 200 uri = /network-bootstore-config
23152025-01-29T07:15:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7047 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 813d4d09-488d-4cab-ad9e-cb90994bc2e0 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
23162025-01-29T07:15:41.111ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43688
23172025-01-29T07:15:41.111ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43688 req_id = 5ae0c46e-cba2-4e55-893c-5e46da418bee response_code = 200 uri = /baseboard
23182025-01-29T07:16:01.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63963
23192025-01-29T07:16:01.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63963 req_id = 5245508b-1767-478b-824d-c9207a455b66 response_code = 200 uri = /v2p
23202025-01-29T07:16:01.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60829
23212025-01-29T07:16:01.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60829 req_id = f4a9295e-56ad-4ed1-bad1-92c8e0785247 response_code = 200 uri = /vpc-routes
23222025-01-29T07:16:01.663ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51760
23232025-01-29T07:16:01.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51760 req_id = d364143c-87f2-4e1f-8bc2-ac9fc407a6b8 response_code = 200 uri = /vpc-routes
23242025-01-29T07:16:01.683ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23252025-01-29T07:16:01.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51760 req_id = e029ff9f-5ba5-45bc-a87b-159c16d38eaa response_code = 204 uri = /eip-gateways
23262025-01-29T07:16:01.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51760 req_id = f0b4100e-83e1-407a-888c-ad77abbc7153 response_code = 204 uri = /vpc-routes
23272025-01-29T07:16:01.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23282025-01-29T07:16:01.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60829 req_id = 711b0a11-9afa-4c58-91ae-7914ee3e2e26 response_code = 204 uri = /eip-gateways
23292025-01-29T07:16:01.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60829 req_id = a5e00d40-4adc-4eb0-980e-7995b808f243 response_code = 204 uri = /vpc-routes
23302025-01-29T07:16:01.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57810
23312025-01-29T07:16:01.757ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23322025-01-29T07:16:01.802ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23332025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57810 req_id = ffb1b822-27f4-4479-be69-4e4fe54e167b response_code = 204 uri = /switch-ports
23342025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35792
23352025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55994
23362025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57630
23372025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48661
23382025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35792 req_id = 101808bb-a646-4402-87e6-094fb149b299 response_code = 200 uri = /v2p
23392025-01-29T07:16:01.874ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23402025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57630 req_id = 6b63610e-84cf-46c1-8bd7-75328457f366 response_code = 200 uri = /vpc-routes
23412025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57810 req_id = 87dbce9f-e61b-4979-817b-503437a9d1a5 response_code = 200 uri = /network-bootstore-config
23422025-01-29T07:16:01.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55994 req_id = 6c36fa33-9daf-4189-be49-3b9fdd06e764 response_code = 200 uri = /v2p
23432025-01-29T07:16:01.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54611
23442025-01-29T07:16:01.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23452025-01-29T07:16:01.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57630 req_id = d8cf93b1-ab8d-430b-91cf-6cbea779872c response_code = 204 uri = /eip-gateways
23462025-01-29T07:16:01.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 907 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57630 req_id = 05138e04-8554-4636-856a-9279dc0c53a1 response_code = 204 uri = /vpc-routes
23472025-01-29T07:16:01.922ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23482025-01-29T07:16:01.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23492025-01-29T07:16:01.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48661 req_id = 589c13b3-9ce5-466a-9448-42f2c9160437 response_code = 204 uri = /switch-ports
23502025-01-29T07:16:01.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48661 req_id = 2bbf53f3-f5e8-4423-ac82-3693972fe932 response_code = 200 uri = /network-bootstore-config
23512025-01-29T07:16:02.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23522025-01-29T07:16:02.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177601 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54611 req_id = 97642ebe-fcc7-436c-b33e-acc1825693b0 response_code = 204 uri = /switch-ports
23532025-01-29T07:16:02.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54611 req_id = 7c862ce9-55c3-44a5-9660-8a14c1c647bd response_code = 200 uri = /network-bootstore-config
23542025-01-29T07:16:11.006ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7005 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = be2a8b66-2be6-44d7-a820-5ff997a885da response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
23552025-01-29T07:16:11.143ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35086
23562025-01-29T07:16:11.144ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35086 req_id = 08e8a4d9-3d50-42fb-82c5-dd6690ba5039 response_code = 200 uri = /baseboard
23572025-01-29T07:16:31.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61207
23582025-01-29T07:16:31.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61207 req_id = 316ac1c4-6aa2-4f7b-aa6c-657a25c7d6ee response_code = 200 uri = /vpc-routes
23592025-01-29T07:16:31.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23602025-01-29T07:16:31.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61207 req_id = e6cf207c-f449-43d3-85d3-e2871d3ea3fe response_code = 204 uri = /eip-gateways
23612025-01-29T07:16:31.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61207 req_id = 6ce32b35-2b0e-4fb4-bea9-35c29f91bbcc response_code = 204 uri = /vpc-routes
23622025-01-29T07:16:31.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47262
23632025-01-29T07:16:31.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47262 req_id = 93faedad-81a5-46a5-9b1a-3bcdeab3e548 response_code = 200 uri = /vpc-routes
23642025-01-29T07:16:31.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23652025-01-29T07:16:31.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47262 req_id = e4434109-e610-4ee7-a72d-be2da5917152 response_code = 204 uri = /eip-gateways
23662025-01-29T07:16:31.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39355
23672025-01-29T07:16:31.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39355 req_id = af5b36a5-85fd-41d1-8527-36e0e0befb96 response_code = 200 uri = /v2p
23682025-01-29T07:16:31.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47262 req_id = ef94b9bd-bda4-44ce-ab68-eb2fab87eb42 response_code = 204 uri = /vpc-routes
23692025-01-29T07:16:31.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49146
23702025-01-29T07:16:31.885ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23712025-01-29T07:16:31.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23722025-01-29T07:16:31.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49146 req_id = 3cf3c8a5-3b5d-4f4a-b223-650f4a58b73e response_code = 204 uri = /switch-ports
23732025-01-29T07:16:31.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63464
23742025-01-29T07:16:31.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54095
23752025-01-29T07:16:31.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63464 req_id = 1c429623-e854-4682-aa9b-f8dd0f9695ce response_code = 200 uri = /vpc-routes
23762025-01-29T07:16:31.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49146 req_id = ff4aa04e-f377-453c-b19d-6d8eb3bac0ab response_code = 200 uri = /network-bootstore-config
23772025-01-29T07:16:31.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54095 req_id = a667d453-85f8-4e5a-b7a4-8c12ee88dc84 response_code = 200 uri = /v2p
23782025-01-29T07:16:31.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49450
23792025-01-29T07:16:31.983ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23802025-01-29T07:16:32.018ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23812025-01-29T07:16:32.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85978 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49450 req_id = 8c564830-abc9-488e-a12e-042dfb66ef82 response_code = 204 uri = /switch-ports
23822025-01-29T07:16:32.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33653
23832025-01-29T07:16:32.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55171
23842025-01-29T07:16:32.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
23852025-01-29T07:16:32.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63464 req_id = 6202fb12-b851-420f-87b6-de8794360ec7 response_code = 204 uri = /eip-gateways
23862025-01-29T07:16:32.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49450 req_id = f9db71fb-e76b-4de9-ac95-3b6af2a2c59c response_code = 200 uri = /network-bootstore-config
23872025-01-29T07:16:32.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23882025-01-29T07:16:32.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33653 req_id = 720e52e3-dea1-455c-b470-98c7c7dc4d98 response_code = 200 uri = /v2p
23892025-01-29T07:16:32.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63464 req_id = 7d7d88c5-a7eb-44e0-9af4-749240476991 response_code = 204 uri = /vpc-routes
23902025-01-29T07:16:32.109ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23912025-01-29T07:16:32.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91041 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55171 req_id = 06d30f81-1447-4abf-b539-93d661ae955d response_code = 204 uri = /switch-ports
23922025-01-29T07:16:32.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55171 req_id = 3a525d5f-7db4-4c71-9150-d566f42a9ab1 response_code = 200 uri = /network-bootstore-config
23932025-01-29T07:16:41.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7643 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 3c8675d6-a211-4e9e-81b6-2c59d5cbe18d response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
23942025-01-29T07:16:41.176ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37236
23952025-01-29T07:16:41.176ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37236 req_id = 3bb76650-8107-43fb-a3a0-3eb42ce70fb6 response_code = 200 uri = /baseboard
23962025-01-29T07:17:01.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34497
23972025-01-29T07:17:01.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34497 req_id = d399df32-87db-449a-b8fd-4bfb2bd65fe1 response_code = 200 uri = /vpc-routes
23982025-01-29T07:17:01.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52772
23992025-01-29T07:17:01.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52772 req_id = a73ce522-2f94-44eb-ad1d-b801196d032e response_code = 200 uri = /vpc-routes
24002025-01-29T07:17:01.631ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24012025-01-29T07:17:01.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52772 req_id = 43c8f5e8-9701-49f3-b68c-cb7ee1c5fd25 response_code = 204 uri = /eip-gateways
24022025-01-29T07:17:01.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24032025-01-29T07:17:01.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34497 req_id = 182cbcb1-27aa-4984-aade-66d73f6f9bbc response_code = 204 uri = /eip-gateways
24042025-01-29T07:17:01.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59980
24052025-01-29T07:17:01.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59980 req_id = fbaaa294-f3e0-4599-8a33-d3c2834de8f8 response_code = 200 uri = /vpc-routes
24062025-01-29T07:17:01.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52772 req_id = 4b37a69b-ad91-4a7d-a5fb-c1c9a7807f6d response_code = 204 uri = /vpc-routes
24072025-01-29T07:17:01.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34497 req_id = 45cd32fd-75be-4cc5-b399-c95afd952e95 response_code = 204 uri = /vpc-routes
24082025-01-29T07:17:01.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46105
24092025-01-29T07:17:01.680ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24102025-01-29T07:17:01.721ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24112025-01-29T07:17:01.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46105 req_id = dd7ca442-e664-4c99-9138-252b68b0d3df response_code = 204 uri = /switch-ports
24122025-01-29T07:17:01.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39669
24132025-01-29T07:17:01.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33592
24142025-01-29T07:17:01.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24152025-01-29T07:17:01.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59980 req_id = 62c2b3bd-949d-4fd4-bffa-2c8a1bf12b3a response_code = 204 uri = /eip-gateways
24162025-01-29T07:17:01.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46105 req_id = 1343fc7c-98f2-4e19-af4f-f5cbb848b737 response_code = 200 uri = /network-bootstore-config
24172025-01-29T07:17:01.787ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24182025-01-29T07:17:01.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39669 req_id = e00d9cc0-96bb-49a6-a24d-5cc77f2cbb63 response_code = 200 uri = /v2p
24192025-01-29T07:17:01.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59980 req_id = 75401480-a385-469a-9773-3c4e53e6b2ac response_code = 204 uri = /vpc-routes
24202025-01-29T07:17:01.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24212025-01-29T07:17:01.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48132
24222025-01-29T07:17:01.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48132 req_id = 50aa3651-4c11-4345-912b-4fdd72c4a7a5 response_code = 200 uri = /v2p
24232025-01-29T07:17:01.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33592 req_id = 00f0443c-33f4-4566-b42a-9ab5555ed5a3 response_code = 204 uri = /switch-ports
24242025-01-29T07:17:01.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33592 req_id = 7759c194-68c5-4e30-9432-9f711395a421 response_code = 200 uri = /network-bootstore-config
24252025-01-29T07:17:01.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34855
24262025-01-29T07:17:01.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34855 req_id = 26fbf8c0-3805-4d22-ad57-e0718ccd5f90 response_code = 200 uri = /v2p
24272025-01-29T07:17:01.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43091
24282025-01-29T07:17:01.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24292025-01-29T07:17:01.967ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24302025-01-29T07:17:02.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43091 req_id = 221477b5-c7f0-40c8-b6d8-d0ceafac01b2 response_code = 204 uri = /switch-ports
24312025-01-29T07:17:02.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43091 req_id = cc2d5d65-4eaa-412b-adff-edf23831148e response_code = 200 uri = /network-bootstore-config
24322025-01-29T07:17:09.881ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24332025-01-29T07:17:09.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24342025-01-29T07:17:09.914ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1890, tv_nsec: 880570127 } time_to_next_cleanup = 599.99999588s
24352025-01-29T07:17:11.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7570 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = bc8a1bdc-c4cb-4134-9f50-984dfa858f97 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
24362025-01-29T07:17:11.210ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33135
24372025-01-29T07:17:11.210ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33135 req_id = 5395506f-6979-4969-b639-d3ec438e4751 response_code = 200 uri = /baseboard
24382025-01-29T07:17:23.840ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24392025-01-29T07:17:31.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65419
24402025-01-29T07:17:31.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65419 req_id = d18dc7d1-a47b-4698-add7-178ccfa3a932 response_code = 200 uri = /vpc-routes
24412025-01-29T07:17:31.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24422025-01-29T07:17:31.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65419 req_id = cc2725c6-89ed-4769-ad05-dc2448793c1c response_code = 204 uri = /eip-gateways
24432025-01-29T07:17:31.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65419 req_id = 49107e54-d0d6-41cd-bf63-283964698efb response_code = 204 uri = /vpc-routes
24442025-01-29T07:17:31.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57605
24452025-01-29T07:17:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57605 req_id = 44b3f79f-ed3a-4960-9b83-cdc609fc97b3 response_code = 200 uri = /vpc-routes
24462025-01-29T07:17:31.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57052
24472025-01-29T07:17:31.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57052 req_id = b2243a15-b1c5-475d-9070-6d21fb13e96e response_code = 200 uri = /v2p
24482025-01-29T07:17:31.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52030
24492025-01-29T07:17:31.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52030 req_id = 07bed888-d9e4-4a08-ad62-53d3f07f6da2 response_code = 200 uri = /v2p
24502025-01-29T07:17:31.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24512025-01-29T07:17:31.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57605 req_id = 568235d9-c1da-4a74-91a1-ec6474bd06b2 response_code = 204 uri = /eip-gateways
24522025-01-29T07:17:31.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57605 req_id = 586b9f83-c96f-4d33-90f2-bd1c87387276 response_code = 204 uri = /vpc-routes
24532025-01-29T07:17:31.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63332
24542025-01-29T07:17:31.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24552025-01-29T07:17:32.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24562025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120704 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63332 req_id = ba70869d-623e-4e27-8141-92744aa9f3be response_code = 204 uri = /switch-ports
24572025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38137
24582025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33294
24592025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35320
24602025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63332 req_id = 126ed8f2-33e4-4308-bc86-5128d3a60527 response_code = 200 uri = /network-bootstore-config
24612025-01-29T07:17:32.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38137 req_id = 7e09294b-1339-42fa-9ad1-32d402ea3f39 response_code = 200 uri = /vpc-routes
24622025-01-29T07:17:32.093ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24632025-01-29T07:17:32.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35320 req_id = 5ccb1a32-072c-4765-a342-df37fd405c9e response_code = 200 uri = /v2p
24642025-01-29T07:17:32.107ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24652025-01-29T07:17:32.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38137 req_id = 68d387a7-4af9-4b31-90de-84e6250dc35f response_code = 204 uri = /eip-gateways
24662025-01-29T07:17:32.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64295
24672025-01-29T07:17:32.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38137 req_id = d8dbbb2e-3387-4967-a465-12b6dc96a465 response_code = 204 uri = /vpc-routes
24682025-01-29T07:17:32.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24692025-01-29T07:17:32.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24702025-01-29T07:17:32.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33294 req_id = 8dfd91e2-ffd9-4f1f-a639-4c62601e67c4 response_code = 204 uri = /switch-ports
24712025-01-29T07:17:32.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 673 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33294 req_id = 53bfcb18-cb6b-471a-83bd-c6ffa8ac59bd response_code = 200 uri = /network-bootstore-config
24722025-01-29T07:17:32.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24732025-01-29T07:17:32.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64295 req_id = 5e895dd4-d401-4770-a628-a5e4af684743 response_code = 204 uri = /switch-ports
24742025-01-29T07:17:32.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64295 req_id = 1bcf07e7-7473-45db-83cf-34be465335e9 response_code = 200 uri = /network-bootstore-config
24752025-01-29T07:17:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7009 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 58170469-fe5d-4c34-98fa-012789cd5e98 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
24762025-01-29T07:17:41.242ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56250
24772025-01-29T07:17:41.242ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56250 req_id = 72dd4aa0-f44f-4565-ae49-1bcd4b4194c7 response_code = 200 uri = /baseboard
24782025-01-29T07:18:01.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34638
24792025-01-29T07:18:01.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34638 req_id = a2cd8780-27d3-4338-8a28-6f697b1127ec response_code = 200 uri = /vpc-routes
24802025-01-29T07:18:01.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60873
24812025-01-29T07:18:01.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60873 req_id = 05104ab0-0aaf-4102-87be-127868c54837 response_code = 200 uri = /vpc-routes
24822025-01-29T07:18:01.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24832025-01-29T07:18:01.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34638 req_id = a81022e8-98ab-4f0c-a30b-ae1ae8a31ddd response_code = 204 uri = /eip-gateways
24842025-01-29T07:18:01.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34638 req_id = c5bce505-4358-4a05-81c2-198cb295a1ff response_code = 204 uri = /vpc-routes
24852025-01-29T07:18:01.676ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24862025-01-29T07:18:01.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60873 req_id = fb009719-99e1-47b2-af73-b363cf4c27ca response_code = 204 uri = /eip-gateways
24872025-01-29T07:18:01.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49632
24882025-01-29T07:18:01.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49632 req_id = fbcecdda-348f-4cdf-912d-93feedc897ac response_code = 200 uri = /vpc-routes
24892025-01-29T07:18:01.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60873 req_id = cf1ed626-20a9-4879-9187-7724f59a9fea response_code = 204 uri = /vpc-routes
24902025-01-29T07:18:01.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58442
24912025-01-29T07:18:01.701ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24922025-01-29T07:18:01.754ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24932025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110690 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58442 req_id = a6b089ad-d915-4b4a-813e-763051d7a24f response_code = 204 uri = /switch-ports
24942025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51911
24952025-01-29T07:18:01.812ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
24962025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49632 req_id = 39ec31a5-f5b1-47e9-aee2-cbc8744f2fae response_code = 204 uri = /eip-gateways
24972025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65078
24982025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63501
24992025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43119
25002025-01-29T07:18:01.812ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25012025-01-29T07:18:01.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58442 req_id = 57c7a25e-f5a4-44dd-933d-eab0eb328103 response_code = 200 uri = /network-bootstore-config
25022025-01-29T07:18:01.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61423
25032025-01-29T07:18:01.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4089 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43119 req_id = 1b20d02d-c758-4f69-9764-7af8754c11b1 response_code = 200 uri = /v2p
25042025-01-29T07:18:01.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63501 req_id = 65f82460-97eb-497e-b8d1-057b502cc3a5 response_code = 200 uri = /v2p
25052025-01-29T07:18:01.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4020 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65078 req_id = d30a75bc-0784-496b-acb4-e9d96f7aa239 response_code = 200 uri = /v2p
25062025-01-29T07:18:01.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49632 req_id = b97dff3a-d30a-4b4b-9b09-5aec7d892ca4 response_code = 204 uri = /vpc-routes
25072025-01-29T07:18:01.849ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25082025-01-29T07:18:01.900ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25092025-01-29T07:18:01.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51911 req_id = 5de00013-4f06-48ce-a45b-67e4adbab9e4 response_code = 204 uri = /switch-ports
25102025-01-29T07:18:01.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51911 req_id = 44edb45b-9602-447e-84be-ffc99068d754 response_code = 200 uri = /network-bootstore-config
25112025-01-29T07:18:01.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25122025-01-29T07:18:01.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168468 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61423 req_id = 348e3967-8323-4e37-ad9e-0d956b3abbfc response_code = 204 uri = /switch-ports
25132025-01-29T07:18:01.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61423 req_id = c75e67a1-ee79-47c8-82c6-7ffacf6cdb3b response_code = 200 uri = /network-bootstore-config
25142025-01-29T07:18:11.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8282 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = b25f73df-1ebd-4aad-94b5-b6ad92e3c0fc response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
25152025-01-29T07:18:11.284ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58033
25162025-01-29T07:18:11.284ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:58033 req_id = 84877d21-9e54-4b0a-88bf-b5511157312a response_code = 200 uri = /baseboard
25172025-01-29T07:18:31.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55637
25182025-01-29T07:18:31.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55637 req_id = 313a6914-9a3a-4eb2-9302-68353702d5f3 response_code = 200 uri = /vpc-routes
25192025-01-29T07:18:31.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52575
25202025-01-29T07:18:31.699ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52575 req_id = 0edeb7e8-ed60-459b-942f-0b16defa1902 response_code = 200 uri = /v2p
25212025-01-29T07:18:31.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49951
25222025-01-29T07:18:31.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49951 req_id = 13abf8b9-b1fd-413f-b5ff-16467bf99766 response_code = 200 uri = /vpc-routes
25232025-01-29T07:18:31.766ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25242025-01-29T07:18:31.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55637 req_id = e00453c7-a32d-437a-9378-2c44f150aec1 response_code = 204 uri = /eip-gateways
25252025-01-29T07:18:31.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25262025-01-29T07:18:31.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49951 req_id = b3ecb91e-34ff-49ef-a714-66c3934ee88b response_code = 204 uri = /eip-gateways
25272025-01-29T07:18:31.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55637 req_id = 414c6359-5cdd-46e4-9386-bdc915e1ecad response_code = 204 uri = /vpc-routes
25282025-01-29T07:18:31.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49951 req_id = 664c17ee-9af8-4dbf-ba0e-f0eed29bd787 response_code = 204 uri = /vpc-routes
25292025-01-29T07:18:31.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59598
25302025-01-29T07:18:31.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25312025-01-29T07:18:31.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25322025-01-29T07:18:31.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59598 req_id = f43cd46f-598c-43d9-8880-a306a0602495 response_code = 204 uri = /switch-ports
25332025-01-29T07:18:31.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35049
25342025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45571
25352025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54336
25362025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42063
25372025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54336 req_id = 96df6bbc-8cc2-4246-ba63-1f64a7c4d9e3 response_code = 200 uri = /v2p
25382025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35049 req_id = e0510588-8f05-48ba-95a9-d262f1ac1066 response_code = 200 uri = /vpc-routes
25392025-01-29T07:18:31.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25402025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59598 req_id = f20b2b64-19c7-4589-abbd-eb8037eb7f10 response_code = 200 uri = /network-bootstore-config
25412025-01-29T07:18:31.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45571 req_id = 6f8f41c5-53f3-4cae-b342-4cddd3c8d2b6 response_code = 200 uri = /v2p
25422025-01-29T07:18:32.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54294
25432025-01-29T07:18:32.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25442025-01-29T07:18:32.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25452025-01-29T07:18:32.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 751 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35049 req_id = d7941c88-a645-4d15-bad5-07b15fc4226d response_code = 204 uri = /eip-gateways
25462025-01-29T07:18:32.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35049 req_id = dd5c2f15-2a0d-4710-a4da-1f80c587b3d2 response_code = 204 uri = /vpc-routes
25472025-01-29T07:18:32.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25482025-01-29T07:18:32.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42063 req_id = c71bb815-362e-48d5-bbb4-a5e90a11992f response_code = 204 uri = /switch-ports
25492025-01-29T07:18:32.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42063 req_id = 9036d497-5566-407a-9204-8e50743f9f8f response_code = 200 uri = /network-bootstore-config
25502025-01-29T07:18:32.149ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25512025-01-29T07:18:32.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54294 req_id = c4822b6c-ea01-479e-9eb2-5a65bff7bffb response_code = 204 uri = /switch-ports
25522025-01-29T07:18:32.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54294 req_id = b866478d-974b-4e1f-9429-15e023f4b060 response_code = 200 uri = /network-bootstore-config
25532025-01-29T07:18:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7450 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 1b6e1606-8460-46e3-ad48-34f20e244bed response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
25542025-01-29T07:18:41.317ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36580
25552025-01-29T07:18:41.317ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36580 req_id = 349a5828-0a6a-402b-a3dd-87a375a2e0a4 response_code = 200 uri = /baseboard
25562025-01-29T07:19:01.658ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58871
25572025-01-29T07:19:01.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58871 req_id = a293e050-7e25-43e1-a265-b6cec94386f1 response_code = 200 uri = /vpc-routes
25582025-01-29T07:19:01.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62696
25592025-01-29T07:19:01.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62696 req_id = de9b5df3-e7e6-41a1-b1bc-6c3a5e2d9a8f response_code = 200 uri = /vpc-routes
25602025-01-29T07:19:01.678ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25612025-01-29T07:19:01.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58871 req_id = fa504bc2-51e9-4727-a415-da748e06c7e2 response_code = 204 uri = /eip-gateways
25622025-01-29T07:19:01.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37402
25632025-01-29T07:19:01.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37402 req_id = 9db4e639-468c-4f55-b0c4-9e99c200ddd6 response_code = 200 uri = /v2p
25642025-01-29T07:19:01.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58871 req_id = 3783ec9e-2217-42a5-bdd8-40ebeb256897 response_code = 204 uri = /vpc-routes
25652025-01-29T07:19:01.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55994
25662025-01-29T07:19:01.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55994 req_id = aa84136d-3281-4962-b7e0-5d57ae00287b response_code = 200 uri = /vpc-routes
25672025-01-29T07:19:01.722ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25682025-01-29T07:19:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55994 req_id = 2c8443d9-5186-4be8-8a31-969182d22e74 response_code = 204 uri = /eip-gateways
25692025-01-29T07:19:01.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25702025-01-29T07:19:01.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62696 req_id = 29c64cad-e0f5-40a7-8138-3567686f296f response_code = 204 uri = /eip-gateways
25712025-01-29T07:19:01.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55994 req_id = fd4329a5-09c3-40c1-95aa-4f6ea27e6dde response_code = 204 uri = /vpc-routes
25722025-01-29T07:19:01.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57861
25732025-01-29T07:19:01.735ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25742025-01-29T07:19:01.775ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25752025-01-29T07:19:01.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93044 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57861 req_id = 098fa330-9cd6-4308-89c4-c68a67781fd6 response_code = 204 uri = /switch-ports
25762025-01-29T07:19:01.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57230
25772025-01-29T07:19:01.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60144
25782025-01-29T07:19:01.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 437 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62696 req_id = f5413cb9-163e-4a8c-8bb0-a3bc4d1c3d1f response_code = 204 uri = /vpc-routes
25792025-01-29T07:19:01.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57861 req_id = 8c3a64dc-75b5-43c8-828e-d2bd94312888 response_code = 200 uri = /network-bootstore-config
25802025-01-29T07:19:01.829ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25812025-01-29T07:19:01.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57230 req_id = 0dea5bc8-24db-4d68-9325-0169bacf40ed response_code = 200 uri = /v2p
25822025-01-29T07:19:01.869ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25832025-01-29T07:19:01.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65322
25842025-01-29T07:19:01.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65322 req_id = c099f4ac-9efa-4647-bae4-7f022c227595 response_code = 200 uri = /v2p
25852025-01-29T07:19:01.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60144 req_id = eba7ef24-03b2-4503-8628-e1fa65917418 response_code = 204 uri = /switch-ports
25862025-01-29T07:19:01.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60144 req_id = 6ae3154a-70f5-4bbb-b518-c76f4d75f94e response_code = 200 uri = /network-bootstore-config
25872025-01-29T07:19:01.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34902
25882025-01-29T07:19:01.996ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25892025-01-29T07:19:02.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25902025-01-29T07:19:02.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34902 req_id = 87abed01-4db2-435f-bb16-b6831f3f0078 response_code = 204 uri = /switch-ports
25912025-01-29T07:19:02.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34902 req_id = bdee76f0-43ea-4a11-b95e-7ae6972989fe response_code = 200 uri = /network-bootstore-config
25922025-01-29T07:19:11.008ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8416 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 00337311-6abe-4236-ade8-36b6b5aca5fa response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
25932025-01-29T07:19:11.357ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33125
25942025-01-29T07:19:11.358ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33125 req_id = 90de20da-07b2-469c-b7e8-62319ae6131b response_code = 200 uri = /baseboard
25952025-01-29T07:19:31.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62745
25962025-01-29T07:19:31.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62745 req_id = 5492799b-f791-452b-8a8d-53b15935877a response_code = 200 uri = /vpc-routes
25972025-01-29T07:19:31.787ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
25982025-01-29T07:19:31.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62745 req_id = 713a8228-2530-49ba-971e-0495acc923c2 response_code = 204 uri = /eip-gateways
25992025-01-29T07:19:31.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62745 req_id = e2000022-805e-452a-a964-83d9be21125e response_code = 204 uri = /vpc-routes
26002025-01-29T07:19:31.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54855
26012025-01-29T07:19:31.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54855 req_id = 1ba7fc8d-52e2-4ac0-ab10-db88e28006f7 response_code = 200 uri = /vpc-routes
26022025-01-29T07:19:31.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
26032025-01-29T07:19:31.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54855 req_id = e921e2d0-ce5f-4e45-a2e4-cfb338d6fd5f response_code = 204 uri = /eip-gateways
26042025-01-29T07:19:31.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38073
26052025-01-29T07:19:31.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38073 req_id = c5a21ad9-4e37-45e8-a8aa-5b79a42b6ce2 response_code = 200 uri = /v2p
26062025-01-29T07:19:31.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46095
26072025-01-29T07:19:31.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46095 req_id = eb66137c-0b21-4992-85b0-3ae1c06c3d71 response_code = 200 uri = /v2p
26082025-01-29T07:19:31.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33465
26092025-01-29T07:19:31.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26102025-01-29T07:19:31.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 479 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33465 req_id = eb78d24a-bba0-48be-b45a-5fd5e3fe40e4 response_code = 200 uri = /artifacts
26112025-01-29T07:19:31.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40459
26122025-01-29T07:19:31.977ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26132025-01-29T07:19:31.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40459 req_id = eeea1321-c3fd-46cd-b53d-0a3cb6bc6c39 response_code = 200 uri = /artifacts
26142025-01-29T07:19:31.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54855 req_id = 05afe60c-22a2-4eeb-80a2-4a6d29c4b000 response_code = 204 uri = /vpc-routes
26152025-01-29T07:19:32.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32892
26162025-01-29T07:19:32.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32892 req_id = 2660fa02-7bc7-4f73-bb46-298e12d0ef78 response_code = 200 uri = /vpc-routes
26172025-01-29T07:19:32.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47563
26182025-01-29T07:19:32.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26192025-01-29T07:19:32.072ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26202025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138473 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47563 req_id = bfaf1b08-2c0c-44c1-a139-02fd92bcd86b response_code = 204 uri = /switch-ports
26212025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58907
26222025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60408
26232025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55055
26242025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40646
26252025-01-29T07:19:32.150ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
26262025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32892 req_id = 71b708e0-0538-49c6-9184-5b3a8354997f response_code = 204 uri = /eip-gateways
26272025-01-29T07:19:32.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47563 req_id = 4cef01a2-4193-4a28-92aa-f4839022e967 response_code = 200 uri = /network-bootstore-config
26282025-01-29T07:19:32.151ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26292025-01-29T07:19:32.151ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26302025-01-29T07:19:32.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26312025-01-29T07:19:32.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26322025-01-29T07:19:32.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26332025-01-29T07:19:32.157ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
26342025-01-29T07:19:32.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6904 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58907 req_id = 148c0bd7-a465-42e6-83d2-40c7ea30f9b3 response_code = 200 uri = /artifacts
26352025-01-29T07:19:32.158ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
26362025-01-29T07:19:32.173ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-01-29T07:19:32.173ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db2b1192-66c6-4615-a94b-80071566494f
26382025-01-29T07:19:32.187ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26392025-01-29T07:19:32.188ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
26402025-01-29T07:19:32.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60506
26412025-01-29T07:19:32.193ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
26422025-01-29T07:19:32.199ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26432025-01-29T07:19:32.203ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26442025-01-29T07:19:32.203ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd
26452025-01-29T07:19:32.204ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26462025-01-29T07:19:32.204ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26472025-01-29T07:19:32.210ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26482025-01-29T07:19:32.210ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26492025-01-29T07:19:32.210ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26502025-01-29T07:19:32.210ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26512025-01-29T07:19:32.210ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26522025-01-29T07:19:32.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10779 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60506 req_id = 34c8e512-b7dc-4286-bbfc-71c5350cd501 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26532025-01-29T07:19:32.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37078
26542025-01-29T07:19:32.219ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552025-01-29T07:19:32.219ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db2b1192-66c6-4615-a94b-80071566494f
26562025-01-29T07:19:32.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52541
26572025-01-29T07:19:32.230ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26582025-01-29T07:19:32.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26592025-01-29T07:19:32.230ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26602025-01-29T07:19:32.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26612025-01-29T07:19:32.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26622025-01-29T07:19:32.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26632025-01-29T07:19:32.233ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26642025-01-29T07:19:32.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26652025-01-29T07:19:32.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8064 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52541 req_id = 1e14a73c-256c-4f51-8f6d-017d7969eb24 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26662025-01-29T07:19:32.233ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26672025-01-29T07:19:32.233ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/config/omicron-zones.json file = common/src/ledger.rs:177
26682025-01-29T07:19:32.245ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26692025-01-29T07:19:32.246ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe
26702025-01-29T07:19:32.250ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/config/omicron-zones.json file = common/src/ledger.rs:177
26712025-01-29T07:19:32.261ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26722025-01-29T07:19:32.261ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd
26732025-01-29T07:19:32.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62890
26742025-01-29T07:19:32.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62890 req_id = 1bee764e-d6df-4809-9098-8336bd68a00f response_code = 200 uri = /v2p
26752025-01-29T07:19:32.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120708 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55055 req_id = 122c7c18-b6d8-4780-8856-c2ca909d51fe response_code = 204 uri = /switch-ports
26762025-01-29T07:19:32.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55055 req_id = 0188b50d-64fa-4f62-9f80-137c547a1a9b response_code = 200 uri = /network-bootstore-config
26772025-01-29T07:19:32.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32892 req_id = e6133bbc-4982-43e6-8e1f-6df3a8f9af5b response_code = 204 uri = /vpc-routes
26782025-01-29T07:19:32.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: db2b1192-66c6-4615-a94b-80071566494f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26792025-01-29T07:19:32.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_db2b1192-66c6-4615-a94b-80071566494f
26802025-01-29T07:19:32.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53706
26812025-01-29T07:19:32.285ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26822025-01-29T07:19:32.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26832025-01-29T07:19:32.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13
26842025-01-29T07:19:32.316ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 66298bbe-4c3d-4352-b27d-95a4c11b39dd (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26852025-01-29T07:19:32.316ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_66298bbe-4c3d-4352-b27d-95a4c11b39dd
26862025-01-29T07:19:32.332ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26872025-01-29T07:19:32.332ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe
26882025-01-29T07:19:32.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26892025-01-29T07:19:32.350ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26902025-01-29T07:19:32.351ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c196feef-7346-4e4f-b19c-8b3b0708c867
26912025-01-29T07:19:32.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26922025-01-29T07:19:32.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13
26932025-01-29T07:19:32.384ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: eaa852c3-3266-4ba9-bc62-7a77bf2c88fe (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26942025-01-29T07:19:32.384ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_eaa852c3-3266-4ba9-bc62-7a77bf2c88fe
26952025-01-29T07:19:32.400ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26962025-01-29T07:19:32.401ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2
26972025-01-29T07:19:32.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49193
26982025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 242a8b73-1fac-4a4c-99aa-69cb91a8ae4a, kind: Service { id: 242fa19c-184b-4bd6-a1bc-55c646ad7af8 }, name: Name("external-dns-242fa19c-184b-4bd6-a1bc-55c646ad7af8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 237, 58])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b7500628-6ef3-4de5-98ec-b37abdd8adc1, kind: Service { id: 01a9123b-a40f-43f0-b4e1-1717d41c64e1 }, name: Name("external-dns-01a9123b-a40f-43f0-b4e1-1717d41c64e1"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 226fe046-7fda-4eb8-a0ac-9b38867d3429, kind: Service { id: 743ecea7-7289-4313-a63e-3da7b1094b32 }, name: Name("nexus-743ecea7-7289-4313-a63e-3da7b1094b32"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 98])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a287e328-c8a2-4c3e-9e01-82d1908d94df, kind: Service { id: 20f094a8-c046-4dfe-9251-74c4f111b769 }, name: Name("nexus-20f094a8-c046-4dfe-9251-74c4f111b769"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fde10080-9b9b-4db5-a60b-9c912a00d585, kind: Service { id: 843b5e15-211c-4e58-8221-57299c421beb }, name: Name("nexus-843b5e15-211c-4e58-8221-57299c421beb"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26992025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27002025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27012025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27022025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27032025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27042025-01-29T07:19:32.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27052025-01-29T07:19:32.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 948 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49193 req_id = 4959192f-ffea-4339-b767-f832be0b93d3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27062025-01-29T07:19:32.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134266 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53706 req_id = baba27b2-518b-4c14-bf40-b95be4066219 response_code = 204 uri = /switch-ports
27072025-01-29T07:19:32.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53706 req_id = d2f8852a-4553-4ec0-b20f-b757a7562d20 response_code = 200 uri = /network-bootstore-config
27082025-01-29T07:19:32.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 17ff7dfa-c764-469d-b4f3-b1a9ada45c13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27092025-01-29T07:19:32.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_17ff7dfa-c764-469d-b4f3-b1a9ada45c13
27102025-01-29T07:19:32.442ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27112025-01-29T07:19:32.445ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c196feef-7346-4e4f-b19c-8b3b0708c867
27122025-01-29T07:19:32.462ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27132025-01-29T07:19:32.462ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2
27142025-01-29T07:19:32.478ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c196feef-7346-4e4f-b19c-8b3b0708c867 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-01-29T07:19:32.480ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c196feef-7346-4e4f-b19c-8b3b0708c867
27162025-01-29T07:19:32.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172025-01-29T07:19:32.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2
27182025-01-29T07:19:32.515ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27192025-01-29T07:19:32.516ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_99311bbe-9041-4ee9-9e49-88d0748815df
27202025-01-29T07:19:32.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27212025-01-29T07:19:32.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2
27222025-01-29T07:19:32.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cff91b48-d2ea-47fc-b30b-89174f8eaba2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27232025-01-29T07:19:32.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cff91b48-d2ea-47fc-b30b-89174f8eaba2
27242025-01-29T07:19:32.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27252025-01-29T07:19:32.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_726f1df1-097f-4118-903d-7cffb2ec5c36
27262025-01-29T07:19:32.579ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7e5ed69a-4e90-4202-a923-b5ae4c9231a2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27272025-01-29T07:19:32.579ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7e5ed69a-4e90-4202-a923-b5ae4c9231a2
27282025-01-29T07:19:32.590ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27292025-01-29T07:19:32.590ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_99311bbe-9041-4ee9-9e49-88d0748815df
27302025-01-29T07:19:32.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 443957 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60408 req_id = befa47d6-58e1-4e67-9bb0-b99be8473382 response_code = 200 uri = /inventory
27312025-01-29T07:19:32.613ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27322025-01-29T07:19:32.613ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_726f1df1-097f-4118-903d-7cffb2ec5c36
27332025-01-29T07:19:32.626ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 99311bbe-9041-4ee9-9e49-88d0748815df (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27342025-01-29T07:19:32.626ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_99311bbe-9041-4ee9-9e49-88d0748815df
27352025-01-29T07:19:32.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 479975 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40646 req_id = 5e58fc0d-53ba-4d19-b127-d17d17f4e533 response_code = 200 uri = /inventory
27362025-01-29T07:19:32.649ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 726f1df1-097f-4118-903d-7cffb2ec5c36 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27372025-01-29T07:19:32.649ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_726f1df1-097f-4118-903d-7cffb2ec5c36
27382025-01-29T07:19:32.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 443150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37078 req_id = 2bf0b354-ef3a-41bf-afd6-b4e5b85a6831 response_code = 200 uri = /inventory
27392025-01-29T07:19:41.010ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7445 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 8a8d98c9-f157-4437-b893-5d48bcd425c2 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
27402025-01-29T07:19:41.392ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49169
27412025-01-29T07:19:41.392ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49169 req_id = fe55fd10-8ff0-4f0c-87ce-82aae5f20887 response_code = 200 uri = /baseboard
27422025-01-29T07:20:01.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42916
27432025-01-29T07:20:01.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42916 req_id = 09782ebd-e2f3-4b64-947f-a0ff4c13731d response_code = 200 uri = /vpc-routes
27442025-01-29T07:20:01.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45146
27452025-01-29T07:20:01.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45146 req_id = 5f23a5f0-52e8-4fce-bb91-db11091b86cc response_code = 200 uri = /vpc-routes
27462025-01-29T07:20:01.628ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
27472025-01-29T07:20:01.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42916 req_id = fbe69db7-d244-4d16-8b75-8495a5373217 response_code = 204 uri = /eip-gateways
27482025-01-29T07:20:01.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42916 req_id = 1d31894b-0dc8-4bfe-93c3-ac4ef89f8dea response_code = 204 uri = /vpc-routes
27492025-01-29T07:20:01.650ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
27502025-01-29T07:20:01.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45146 req_id = b3aa7472-33db-4263-99f8-50ece74abd73 response_code = 204 uri = /eip-gateways
27512025-01-29T07:20:01.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45146 req_id = 4b83c1f3-0c77-4fe4-b549-b34102295441 response_code = 204 uri = /vpc-routes
27522025-01-29T07:20:01.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55096
27532025-01-29T07:20:01.699ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27542025-01-29T07:20:01.743ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27552025-01-29T07:20:01.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55096 req_id = ee12140c-1a21-4d33-a45d-73291942f418 response_code = 204 uri = /switch-ports
27562025-01-29T07:20:01.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63350
27572025-01-29T07:20:01.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61158
27582025-01-29T07:20:01.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60234
27592025-01-29T07:20:01.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42244
27602025-01-29T07:20:01.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42244 req_id = 098ed4c5-1ff2-491a-8bbe-2ae229eb43cb response_code = 200 uri = /v2p
27612025-01-29T07:20:01.828ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27622025-01-29T07:20:01.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61158 req_id = 31d1b168-28f5-4ce4-b17c-afcbc8004559 response_code = 200 uri = /v2p
27632025-01-29T07:20:01.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63350 req_id = d81e02ab-a5a4-4730-944a-6e00dd700ba3 response_code = 200 uri = /vpc-routes
27642025-01-29T07:20:01.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55096 req_id = be737f38-dc9c-4015-b345-b2b9d05fe396 response_code = 200 uri = /network-bootstore-config
27652025-01-29T07:20:01.868ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27662025-01-29T07:20:01.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
27672025-01-29T07:20:01.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63350 req_id = a603625e-03f5-4781-8790-f32ab6faf844 response_code = 204 uri = /eip-gateways
27682025-01-29T07:20:01.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55675
27692025-01-29T07:20:01.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 871 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63350 req_id = 8ef9440a-c4f1-4eb7-adf9-031636327d72 response_code = 204 uri = /vpc-routes
27702025-01-29T07:20:01.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27712025-01-29T07:20:01.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60234 req_id = e07c5391-4bfb-4cfa-9d21-486b6627008f response_code = 204 uri = /switch-ports
27722025-01-29T07:20:01.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60234 req_id = 69571885-9b24-4d66-9f4d-d16f32164a53 response_code = 200 uri = /network-bootstore-config
27732025-01-29T07:20:01.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37022
27742025-01-29T07:20:01.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37022 req_id = e9108d83-8341-4864-9247-bde08d44f734 response_code = 200 uri = /v2p
27752025-01-29T07:20:01.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27762025-01-29T07:20:02.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55675 req_id = 90d51a79-3044-4b93-a1bc-1ec3bb841773 response_code = 204 uri = /switch-ports
27772025-01-29T07:20:02.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55675 req_id = 20e3be32-c149-492f-b327-2c27286a093b response_code = 200 uri = /network-bootstore-config
27782025-01-29T07:20:11.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7077 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 90f6c137-6ca4-4f77-88b1-96f0e74dd3ac response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
27792025-01-29T07:20:11.425ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61803
27802025-01-29T07:20:11.425ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61803 req_id = 31e4247e-1d61-4341-9b61-8cfa0bee073b response_code = 200 uri = /baseboard
27812025-01-29T07:20:31.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54819
27822025-01-29T07:20:31.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54819 req_id = eadf7fb8-57b7-4f83-a170-45b2fc0141d6 response_code = 200 uri = /vpc-routes
27832025-01-29T07:20:31.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61963
27842025-01-29T07:20:31.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61963 req_id = ca56a911-a35b-442e-be68-0e31384af28e response_code = 200 uri = /v2p
27852025-01-29T07:20:31.868ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
27862025-01-29T07:20:31.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54819 req_id = 5ec76bd4-f45e-43e8-a1f0-750216884865 response_code = 204 uri = /eip-gateways
27872025-01-29T07:20:31.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54819 req_id = a9262d50-0575-4eff-9506-e780e1f5849e response_code = 204 uri = /vpc-routes
27882025-01-29T07:20:31.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63330
27892025-01-29T07:20:31.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27902025-01-29T07:20:31.951ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27912025-01-29T07:20:32.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93157 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63330 req_id = 1e7d88ce-5a75-4bf2-9136-709d423937c3 response_code = 204 uri = /switch-ports
27922025-01-29T07:20:32.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40544
27932025-01-29T07:20:32.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40544 req_id = a2970272-1bec-40fa-94e0-956b615b3ac4 response_code = 200 uri = /vpc-routes
27942025-01-29T07:20:32.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63330 req_id = 92302cf3-7875-4807-8010-3b42d8e09b41 response_code = 200 uri = /network-bootstore-config
27952025-01-29T07:20:32.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47616
27962025-01-29T07:20:32.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47616 req_id = e6dbcfaf-00e8-4c81-9eb1-68ee8d314f7f response_code = 200 uri = /vpc-routes
27972025-01-29T07:20:32.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60553
27982025-01-29T07:20:32.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27992025-01-29T07:20:32.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28002025-01-29T07:20:32.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60553 req_id = ca1eec3c-471e-48b0-ab20-94a387b71b2d response_code = 204 uri = /switch-ports
28012025-01-29T07:20:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47827
28022025-01-29T07:20:32.150ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
28032025-01-29T07:20:32.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47616 req_id = 3b6e8b2f-c294-4b35-a436-9d9cec53c45e response_code = 204 uri = /eip-gateways
28042025-01-29T07:20:32.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51036
28052025-01-29T07:20:32.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51552
28062025-01-29T07:20:32.151ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
28072025-01-29T07:20:32.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40544 req_id = 40b4bff7-c595-430e-84ac-8d41edc63a1a response_code = 204 uri = /eip-gateways
28082025-01-29T07:20:32.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60553 req_id = 12a139a2-a7a6-4083-972f-702ef56af6f5 response_code = 200 uri = /network-bootstore-config
28092025-01-29T07:20:32.151ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28102025-01-29T07:20:32.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3995 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51552 req_id = 040c094c-df09-4f85-a1fd-899eea5661c7 response_code = 200 uri = /v2p
28112025-01-29T07:20:32.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51036 req_id = b54333ab-aa99-4bd5-8660-98ac01382f99 response_code = 200 uri = /v2p
28122025-01-29T07:20:32.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40544 req_id = ca1baee3-dd14-447f-88c4-c6e40f751551 response_code = 204 uri = /vpc-routes
28132025-01-29T07:20:32.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47616 req_id = 825b3919-ba6e-4298-8f2c-63eae8a981ad response_code = 204 uri = /vpc-routes
28142025-01-29T07:20:32.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28152025-01-29T07:20:32.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47827 req_id = 5c1fc9e6-ef03-4aca-b18a-9e0a2ddbaa67 response_code = 204 uri = /switch-ports
28162025-01-29T07:20:32.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47827 req_id = 036f610d-960d-44f3-b49e-a45280b132e2 response_code = 200 uri = /network-bootstore-config
28172025-01-29T07:20:36.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44469
28182025-01-29T07:20:36.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44469 req_id = 633a933f-deaf-48c3-bf21-826b41fb8f35 response_code = 200 uri = /v2p
28192025-01-29T07:20:36.971ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16746400) }
28202025-01-29T07:20:36.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44469 req_id = d9e6183d-143f-4ec1-ba05-e11a5cf3df8a response_code = 204 uri = /v2p
28212025-01-29T07:20:37.079ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60235
28222025-01-29T07:20:37.096ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16746400))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: c9c63aba-ee54-4b2b-b2f7-8da05f62aece, slot: 0, read_only: false, vcr_json: .., name: "disk-89402494064" }], boot_settings: Some(InstanceBootSettings { order: [c9c63aba-ee54-4b2b-b2f7-8da05f62aece] }), cloud_init_bytes: Some(..) } instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a metadata = InstanceMetadata { silo_id: 9c6ef507-365c-499f-8176-add49a0be008, project_id: e1d6deaf-8a64-4173-b8c0-e55ebe978861 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-29T07:20:37.079681078Z }
28232025-01-29T07:20:37.096ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a migration_id = None propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28242025-01-29T07:20:37.096ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a migration_id = None propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16746400))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 6f081176-d90f-4059-804c-800726c267a2, kind: Instance { id: 3013d140-d5d5-49bd-b31f-a8546cc0c95a }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16746400), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: c9c63aba-ee54-4b2b-b2f7-8da05f62aece, slot: 0, read_only: false, vcr_json: .., name: "disk-89402494064" }], boot_settings: Some(InstanceBootSettings { order: [c9c63aba-ee54-4b2b-b2f7-8da05f62aece] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-29T07:20:37.079681078Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
28252025-01-29T07:20:37.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60235 req_id = 7b90dfa1-a5d0-4e54-b85a-4d954fa80b4b response_code = 200 uri = /vmms/41607b68-c294-4b1c-be83-5a7e7d8669bf
28262025-01-29T07:20:37.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51251
28272025-01-29T07:20:37.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 785 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51251 req_id = 4f490bdc-ca37-46d0-a00a-1d8b65c37fb3 response_code = 200 uri = /vmms/41607b68-c294-4b1c-be83-5a7e7d8669bf/state
28282025-01-29T07:20:37.184ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16746400 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
28292025-01-29T07:20:37.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28302025-01-29T07:20:37.228ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf file = illumos-utils/src/zone.rs:325 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28312025-01-29T07:20:37.254ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf file = illumos-utils/src/zone.rs:363 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28322025-01-29T07:20:37.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45586
28332025-01-29T07:20:37.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45586 req_id = 47ce945e-8ea5-4970-9b66-cb0dc9981048 response_code = 200 uri = /vpc-routes
28342025-01-29T07:20:37.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {6f081176-d90f-4059-804c-800726c267a2: {10.151.1.176: {2209a7cb-9698-4d74-8f5a-33361b193471}, 10.151.1.175: {2209a7cb-9698-4d74-8f5a-33361b193471}}} }
28352025-01-29T07:20:38.789ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28362025-01-29T07:20:38.790ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf zone file = illumos-utils/src/running_zone.rs:488 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28372025-01-29T07:20:38.985ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 56.622438ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28382025-01-29T07:20:39.059ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 136.365477ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28392025-01-29T07:20:39.217ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 135.214202ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28402025-01-29T07:20:39.364ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 284.299833ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28412025-01-29T07:20:39.665ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 732.380914ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28422025-01-29T07:20:40.408ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 579.138411ms file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28432025-01-29T07:20:41.000ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 1.219957629s file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28442025-01-29T07:20:41.007ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7618 local_addr = [fd00:1122:3344:101::1]:56462 method = GET remote_addr = [fd00:1122:3344:101::d]:54365 req_id = 8f3e7dec-0cee-4376-8fc4-0cbe1c317412 response_code = 200 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 uri = /6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
28452025-01-29T07:20:41.456ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44342
28462025-01-29T07:20:41.456ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44342 req_id = 11a55443-a9ac-4943-99dd-1a04513eeb40 response_code = 200 uri = /baseboard
28472025-01-29T07:20:42.233ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 1.403350462s file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28482025-01-29T07:20:43.648ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf") failed: Property not found. retry in 1.410908352s file = illumos-utils/src/svc.rs:42 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf zone = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28492025-01-29T07:20:45.088ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf file = sled-agent/src/instance.rs:2068 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28502025-01-29T07:20:45.098ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28512025-01-29T07:20:45.135ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28522025-01-29T07:20:45.211ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28532025-01-29T07:20:45.213ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1260 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
28542025-01-29T07:20:45.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7901571 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45586 req_id = 6a19af4d-8792-403b-bb4a-668cb0a73d04 response_code = 204 uri = /eip-gateways
28552025-01-29T07:20:45.213ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-29T07:20:45.213657542Z } file = sled-agent/src/instance.rs:781 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28562025-01-29T07:20:45.213ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-29T07:20:45.213657542Z } propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28572025-01-29T07:20:45.214ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-29T07:20:45.213657542Z }, migration_in: None, migration_out: None }
28582025-01-29T07:20:45.233ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-29T07:20:45.233477294Z } file = sled-agent/src/instance.rs:781 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28592025-01-29T07:20:45.233ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-29T07:20:45.233477294Z } propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28602025-01-29T07:20:45.233ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-29T07:20:45.233477294Z }, migration_in: None, migration_out: None }
28612025-01-29T07:20:45.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45586 req_id = 5359e042-776a-4725-96c7-030c39f4d691 response_code = 204 uri = /vpc-routes
28622025-01-29T07:20:54.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38350
28632025-01-29T07:20:54.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 660 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38350 req_id = ce2ba27e-6772-4c4b-b97d-23b288660332 response_code = 200 uri = /vmms/41607b68-c294-4b1c-be83-5a7e7d8669bf/state
28642025-01-29T07:20:54.680ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-29T07:20:54.680291683Z } file = sled-agent/src/instance.rs:781 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28652025-01-29T07:20:54.680ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-29T07:20:54.680291683Z } propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28662025-01-29T07:20:54.680ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-29T07:20:54.680291683Z }, migration_in: None, migration_out: None }
28672025-01-29T07:20:54.697ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-29T07:20:54.697862165Z } file = sled-agent/src/instance.rs:781 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28682025-01-29T07:20:54.697ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-29T07:20:54.697862165Z } propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28692025-01-29T07:20:54.697ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28702025-01-29T07:20:54.697ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28712025-01-29T07:20:54.698ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28722025-01-29T07:20:54.698ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/262d7da5-bb6c-4c68-92ca-0b1a5f7dcefe/debug/bundle/zone", "/pool/int/ea3e8bb2-6b6c-4f7d-8128-13295772a53f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/db2b1192-66c6-4615-a94b-80071566494f/crypt/debug", "/pool/ext/66298bbe-4c3d-4352-b27d-95a4c11b39dd/crypt/debug", "/pool/ext/eaa852c3-3266-4ba9-bc62-7a77bf2c88fe/crypt/debug", "/pool/ext/17ff7dfa-c764-469d-b4f3-b1a9ada45c13/crypt/debug", "/pool/ext/c196feef-7346-4e4f-b19c-8b3b0708c867/crypt/debug", "/pool/ext/cff91b48-d2ea-47fc-b30b-89174f8eaba2/crypt/debug", "/pool/ext/7e5ed69a-4e90-4202-a923-b5ae4c9231a2/crypt/debug", "/pool/ext/99311bbe-9041-4ee9-9e49-88d0748815df/crypt/debug", "/pool/ext/726f1df1-097f-4118-903d-7cffb2ec5c36/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf
28732025-01-29T07:20:55.329ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf", bundle_id: 59d026dd-5303-43c6-83eb-71f35b493014 }, time_created: 2025-01-29T07:20:54.699351565Z, version: 0, cause: TerminatedInstance }
28742025-01-29T07:20:55.329ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_41607b68-c294-4b1c-be83-5a7e7d8669bf file = sled-agent/src/instance.rs:1314 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28752025-01-29T07:20:57.061ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28762025-01-29T07:20:57.077ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16746400), kind: System }
28772025-01-29T07:20:57.077ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16746400), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28782025-01-29T07:20:57.079ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-29T07:20:57.079068341Z }, migration_in: None, migration_out: None }
28792025-01-29T07:20:57.103ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-29T07:20:57.079068341Z }, migration_in: None, migration_out: None }
28802025-01-29T07:20:57.108ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 3013d140-d5d5-49bd-b31f-a8546cc0c95a propolis_id = 41607b68-c294-4b1c-be83-5a7e7d8669bf
28812025-01-29T07:20:57.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53547
28822025-01-29T07:20:57.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53547 req_id = d0c84daa-3db7-4d20-86b1-6fd61deb9b50 response_code = 200 uri = /vpc-routes
28832025-01-29T07:20:57.466ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {6f081176-d90f-4059-804c-800726c267a2: {10.151.1.176: {2209a7cb-9698-4d74-8f5a-33361b193471}, 10.151.1.175: {2209a7cb-9698-4d74-8f5a-33361b193471}}} }
28842025-01-29T07:20:57.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53547 req_id = 0e1c6e3b-5d81-4115-a811-55b9701d533e response_code = 204 uri = /eip-gateways
28852025-01-29T07:20:57.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53547 req_id = 6d26b757-1b88-427c-b3ce-079d4c1a3ba7 response_code = 204 uri = /vpc-routes
28862025-01-29T07:20:57.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41911
28872025-01-29T07:20:57.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41911 req_id = 7ede0cb6-c8ed-4894-acbc-2c36d07fdb98 response_code = 200 uri = /v2p
28882025-01-29T07:20:57.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46750
28892025-01-29T07:20:57.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46750 req_id = 3c7259b4-8c2e-4ee2-b3bd-8160f45271fe response_code = 200 uri = /v2p
28902025-01-29T07:20:57.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62556
28912025-01-29T07:20:57.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62556 req_id = 1024bf26-e673-4d0d-afc2-0d290a2dde75 response_code = 200 uri = /vpc-routes
28922025-01-29T07:20:57.993ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
28932025-01-29T07:20:57.993ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1260 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4
28942025-01-29T07:20:57.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62556 req_id = c823644f-9f53-411c-9a22-4db710bca8ba response_code = 204 uri = /eip-gateways
28952025-01-29T07:20:58.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 338 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62556 req_id = 71843686-0a23-4477-9e6a-4066c1189695 response_code = 204 uri = /vpc-routes
28962025-01-29T07:20:58.562ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40800
28972025-01-29T07:20:58.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40800 req_id = 5c01fda8-45cb-4b75-95cd-139fafb0f99d response_code = 200 uri = /vpc-routes
28982025-01-29T07:20:58.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1234 sled_id = 6e725a65-3e84-4bcb-8d5c-2bc10a3849f4 values = ExternalIpGatewayMap { mappings: {} }
28992025-01-29T07:20:58.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40800 req_id = 2fc95e0f-43cf-4ba7-8d2e-93212f592e6d response_code = 204 uri = /eip-gateways
29002025-01-29T07:20:58.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40800 req_id = 91c20fbd-03c5-450b-ba09-fbb345c82080 response_code = 204 uri = /vpc-routes