Max level shown:
1 [ Dec 18 19:44:17 Enabled. ]
2 [ Dec 18 19:44:17 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 18 19:44:17 Method "start" exited with status 0. ]
4 [ Dec 18 19:44:17 Rereading configuration. ]
5 [ Dec 18 19:44:17 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-18T19:44:17.246ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-18T19:44:17.246ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-18T19:44:17.298ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-18T19:44:17.298ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-18T19:44:17.413ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-18T19:44:17.422ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-18T19:44:17.429ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-18T19:44:18.028ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-18T19:44:18.165ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-18T19:44:18.165ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-18T19:44:18.165ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-18T19:44:18.165ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-18T19:44:18.165ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-18T19:44:18.165ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-18T19:44:18.168ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-18T19:44:18.168ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-18T19:44:18.168ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-18T19:44:18.168ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-18T19:44:18.168ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-18T19:44:18.168ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-18T19:44:18.168ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282024-12-18T19:44:18.169ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-18T19:44:18.169ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-18T19:44:18.181ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-18T19:44:18.181ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f1657089-065e-4651-a353-e5d94949a179 (zpool)
322024-12-18T19:44:18.277ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal }
332024-12-18T19:44:18.634ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342024-12-18T19:44:18.634ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-18T19:44:18.634ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-18T19:44:18.634ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-18T19:44:18.634ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382024-12-18T19:44:18.634ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-18T19:44:18.634ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-18T19:44:18.643ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-18T19:44:18.643ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool)
422024-12-18T19:44:18.731ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal }
432024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
652024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
662024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
882024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912024-12-18T19:44:19.093ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932024-12-18T19:44:19.093ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-12-18T19:44:19.093ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-12-18T19:44:19.093ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-18T19:44:19.093ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012024-12-18T19:44:19.093ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022024-12-18T19:44:19.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032024-12-18T19:44:19.093ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-18T19:44:19.093ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-18T19:44:19.093ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-18T19:44:19.093ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-18T19:44:19.104ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-18T19:44:19.104ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1334, tv_nsec: 914711126 } time_to_next_cleanup = 599.999932158s
1142024-12-18T19:44:19.104ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-18T19:44:19.104ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162024-12-18T19:44:19.104ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-18T19:44:19.107ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-18T19:44:19.108ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-18T19:44:19.109ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-18T19:44:19.110ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-18T19:44:19.110ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-18T19:44:19.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232024-12-18T19:44:19.110ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242024-12-18T19:44:19.110ZINFOSledAgent (RSS): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-18T19:44:19.110ZINFOSledAgent (RSS): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-18T19:44:19.110ZINFOSledAgent (RSS): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-18T19:44:19.110ZINFOSledAgent (RSS): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-18T19:44:19.110ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-18T19:44:19.110ZINFOSledAgent (RSS): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-18T19:44:19.110ZINFOSledAgent (RSS): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-18T19:44:19.110ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-18T19:44:19.110ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-18T19:44:19.110ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-18T19:44:19.111ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-18T19:44:19.111ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-18T19:44:19.111ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-18T19:44:19.111ZINFOSledAgent (bootstore): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-18T19:44:19.111ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-18T19:44:19.111ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 58ee29db-9185-4216-97e8-559d204ec1d2 (sled), rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-18T19:44:19.111ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-18T19:44:19.111ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-18T19:44:19.116ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-18T19:44:19.122ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-18T19:44:19.122ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-18T19:44:19.127ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-18T19:44:19.127ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-18T19:44:19.127ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45176
1482024-12-18T19:44:19.127ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 58ee29db-9185-4216-97e8-559d204ec1d2 (sled), rack_id: 460eefc4-cff7-4f04-b6cb-c443459a12a5, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-18T19:44:19.127ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-18T19:44:19.127ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1532024-12-18T19:44:19.127ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-18T19:44:19.127ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602024-12-18T19:44:19.127ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-18T19:44:19.127ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622024-12-18T19:44:19.143ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632024-12-18T19:44:19.163ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-18T19:44:19.180ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-18T19:44:19.191ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1662024-12-18T19:44:19.191ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672024-12-18T19:44:19.191ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1682024-12-18T19:44:19.191ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-18T19:44:19.195ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 136.897224ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e36bf9b0-b0a6-408c-85e0-3f32bb97afd8", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e36bf9b0-b0a6-408c-85e0-3f32bb97afd8" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-18T19:44:19.204ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f1657089-065e-4651-a353-e5d94949a179/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-18T19:44:19.228ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f1657089-065e-4651-a353-e5d94949a179/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-18T19:44:19.228ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f1657089-065e-4651-a353-e5d94949a179/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-18T19:44:19.233ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1742024-12-18T19:44:19.233ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752024-12-18T19:44:19.233ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f1657089-065e-4651-a353-e5d94949a179/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762024-12-18T19:44:19.303ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772024-12-18T19:44:19.334ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782024-12-18T19:44:19.334ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 167.749667ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2715d7c2-3cda-4bdd-b60c-65e1f5be824b", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2715d7c2-3cda-4bdd-b60c-65e1f5be824b" } file = clients/ddm-admin-client/src/lib.rs:177
1792024-12-18T19:44:19.503ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-18T19:44:19.504ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 210.297453ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "30001d17-ad46-449a-9712-0f03a3147ca9", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "30001d17-ad46-449a-9712-0f03a3147ca9" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-18T19:44:19.522ZINFOSledAgent (BackingFs): Mounting oxi_f1657089-065e-4651-a353-e5d94949a179/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822024-12-18T19:44:19.534ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832024-12-18T19:44:19.534ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842024-12-18T19:44:19.534ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852024-12-18T19:44:19.534ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862024-12-18T19:44:19.715ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872024-12-18T19:44:19.715ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 137.818886ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ce4c9569-9211-42fa-ba1d-a7d76bfd93d9", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ce4c9569-9211-42fa-ba1d-a7d76bfd93d9" } file = clients/ddm-admin-client/src/lib.rs:177
1882024-12-18T19:44:19.854ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-18T19:44:19.855ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 294.264579ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2badcab1-fc79-4dd3-a7f6-0baec6e0f17b", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2badcab1-fc79-4dd3-a7f6-0baec6e0f17b" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-18T19:44:20.150ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-18T19:44:20.151ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 318.299158ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6bd8d732-5d5a-46b5-8717-5fb29159d162", "content-length": "124", "date": "Wed, 18 Dec 2024 19:44:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6bd8d732-5d5a-46b5-8717-5fb29159d162" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-18T19:44:20.282ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1932024-12-18T19:44:20.288ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:64949 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1942024-12-18T19:44:20.288ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1952024-12-18T19:44:20.288ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:64949 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 58ee29db-9185-4216-97e8-559d204ec1d2 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1962024-12-18T19:44:20.289ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 362.451962ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1972024-12-18T19:44:20.290ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1982024-12-18T19:44:20.290ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
1992024-12-18T19:44:20.290ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2002024-12-18T19:44:20.290ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012024-12-18T19:44:20.471ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-12-18T19:44:20.655ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 289.535242ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2032024-12-18T19:44:20.947ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 646.167243ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2042024-12-18T19:44:21.596ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.495004815s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2052024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2062024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2072024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2082024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2092024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2102024-12-18T19:44:22.828ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2112024-12-18T19:44:22.830ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2122024-12-18T19:44:22.831ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2132024-12-18T19:44:22.831ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='bcbd5f8a-f91b-41ec-b246-0f9965a43b42'/> <propval type="astring" name="rack_id" value='460eefc4-cff7-4f04-b6cb-c443459a12a5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe52:aac'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='460eefc4-cff7-4f04-b6cb-c443459a12a5'/> <propval type="astring" name="sled_id" value='58ee29db-9185-4216-97e8-559d204ec1d2'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='58ee29db-9185-4216-97e8-559d204ec1d2'/> <propval type="astring" name="rack_uuid" value='460eefc4-cff7-4f04-b6cb-c443459a12a5'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='58ee29db-9185-4216-97e8-559d204ec1d2'/> <propval type="astring" name="rack_uuid" value='460eefc4-cff7-4f04-b6cb-c443459a12a5'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142024-12-18T19:44:22.832ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152024-12-18T19:44:23.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 57.858292ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-12-18T19:44:23.093ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 3.907337373s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2172024-12-18T19:44:23.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 51.455691ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-18T19:44:23.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 136.211224ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-18T19:44:23.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 411.891671ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-18T19:44:24.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 953.893701ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-18T19:44:25.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.033660744s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-18T19:44:26.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 631.658362ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-18T19:44:27.001ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.713140155s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2242024-12-18T19:44:27.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 834.93706ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-18T19:44:28.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 508.757876ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-18T19:44:28.872ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/nexus.rs:527 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2272024-12-18T19:44:28.906ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282024-12-18T19:44:28.906ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2292024-12-18T19:44:28.908ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302024-12-18T19:44:28.908ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312024-12-18T19:44:28.908ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322024-12-18T19:44:28.908ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332024-12-18T19:44:28.908ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-18T19:44:28.908ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352024-12-18T19:44:28.908ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362024-12-18T19:44:28.908ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2372024-12-18T19:44:29.102ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:45176
2382024-12-18T19:44:29.103ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392024-12-18T19:44:29.103ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-18T19:44:29.108ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2412024-12-18T19:44:29.108ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2422024-12-18T19:44:29.108ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2432024-12-18T19:44:29.393ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54282
2442024-12-18T19:44:29.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452024-12-18T19:44:29.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462024-12-18T19:44:29.396ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:188
2472024-12-18T19:44:29.396ZINFOSledAgent (ServiceManager): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:188
2482024-12-18T19:44:29.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54282 req_id = 97fa392f-bf5a-42f4-b9cb-9b53a671d189 response_code = 200 uri = /inventory
2492024-12-18T19:44:29.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44167
2502024-12-18T19:44:29.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44167 req_id = 4f31b1d9-ec4f-4122-a3df-f0ee21f023b7 response_code = 200 uri = /sled-role
2512024-12-18T19:44:29.458ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0c022ddb-2183-4594-b62d-8e02ab6616b0 (physical_disk), pool_id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: fce8a3f7-1450-477c-a215-cadbba8410bc (physical_disk), pool_id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3f964435-a1ba-4cf3-93f5-1a4a2a07875f (physical_disk), pool_id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d274ed3a-c850-4bbc-96d7-0edc27792c96 (physical_disk), pool_id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: e389bfbb-29cd-4b81-8524-65e81800f1bb (physical_disk), pool_id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7a7bec4d-d234-499e-adc6-471cbc46dd2b (physical_disk), pool_id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f5ebe707-924a-4bc5-b7e7-a016e08d4a06 (physical_disk), pool_id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 6834414d-911d-4f4a-8eda-d628a17929f6 (physical_disk), pool_id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 10757dd6-7b59-4fc8-8d7a-8c0e799c3a53 (physical_disk), pool_id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2522024-12-18T19:44:29.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42312
2532024-12-18T19:44:29.459ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2542024-12-18T19:44:29.459ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0c022ddb-2183-4594-b62d-8e02ab6616b0 (physical_disk), pool_id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: fce8a3f7-1450-477c-a215-cadbba8410bc (physical_disk), pool_id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3f964435-a1ba-4cf3-93f5-1a4a2a07875f (physical_disk), pool_id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: d274ed3a-c850-4bbc-96d7-0edc27792c96 (physical_disk), pool_id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: e389bfbb-29cd-4b81-8524-65e81800f1bb (physical_disk), pool_id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 7a7bec4d-d234-499e-adc6-471cbc46dd2b (physical_disk), pool_id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: f5ebe707-924a-4bc5-b7e7-a016e08d4a06 (physical_disk), pool_id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 6834414d-911d-4f4a-8eda-d628a17929f6 (physical_disk), pool_id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 10757dd6-7b59-4fc8-8d7a-8c0e799c3a53 (physical_disk), pool_id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2552024-12-18T19:44:29.459ZINFOSledAgent (StorageManager): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2562024-12-18T19:44:29.459ZINFOSledAgent (StorageManager): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572024-12-18T19:44:29.459ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2582024-12-18T19:44:29.459ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2592024-12-18T19:44:29.459ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2602024-12-18T19:44:29.459ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2612024-12-18T19:44:29.459ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2622024-12-18T19:44:29.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2632024-12-18T19:44:29.601ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool)
2642024-12-18T19:44:30.064ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2652024-12-18T19:44:30.282ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2662024-12-18T19:44:30.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2672024-12-18T19:44:30.293ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
2682024-12-18T19:44:30.330ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }
2692024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2702024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2712024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2722024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2732024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-18T19:44:30.339ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2762024-12-18T19:44:30.375ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-18T19:44:30.383ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone file = sled-storage/src/dataset.rs:302
2782024-12-18T19:44:30.522ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d file = sled-storage/src/dataset.rs:388
2792024-12-18T19:44:30.529ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-18T19:44:30.529ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-18T19:44:30.529ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-18T19:44:30.529ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-18T19:44:30.529ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-18T19:44:30.540ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-18T19:44:30.540ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool)
2862024-12-18T19:44:30.636ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }
2872024-12-18T19:44:30.643ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2882024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2892024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2902024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2912024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-18T19:44:30.644ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2942024-12-18T19:44:30.677ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2952024-12-18T19:44:30.685ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone file = sled-storage/src/dataset.rs:302
2962024-12-18T19:44:30.824ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4585f13b-0248-4d0e-a56e-45d95198a363 file = sled-storage/src/dataset.rs:388
2972024-12-18T19:44:30.832ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2982024-12-18T19:44:30.832ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2992024-12-18T19:44:30.832ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3002024-12-18T19:44:30.832ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3012024-12-18T19:44:30.832ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-12-18T19:44:30.843ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3032024-12-18T19:44:30.843ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool)
3042024-12-18T19:44:30.941ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }
3052024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3062024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3072024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3082024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3092024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-18T19:44:30.949ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3122024-12-18T19:44:30.983ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-12-18T19:44:30.991ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone file = sled-storage/src/dataset.rs:302
3142024-12-18T19:44:31.067ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
3152024-12-18T19:44:31.131ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111 file = sled-storage/src/dataset.rs:388
3162024-12-18T19:44:31.139ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172024-12-18T19:44:31.139ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182024-12-18T19:44:31.139ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192024-12-18T19:44:31.139ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202024-12-18T19:44:31.139ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212024-12-18T19:44:31.148ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222024-12-18T19:44:31.148ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 415023e8-4b60-4f50-85ce-5d337214083f (zpool)
3232024-12-18T19:44:31.242ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }
3242024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3252024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3262024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3272024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3282024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-18T19:44:31.250ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3312024-12-18T19:44:31.287ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-18T19:44:31.295ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone file = sled-storage/src/dataset.rs:302
3332024-12-18T19:44:31.433ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_415023e8-4b60-4f50-85ce-5d337214083f file = sled-storage/src/dataset.rs:388
3342024-12-18T19:44:31.441ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-18T19:44:31.441ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-18T19:44:31.441ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-18T19:44:31.441ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-18T19:44:31.441ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-18T19:44:31.452ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-18T19:44:31.452ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool)
3412024-12-18T19:44:31.544ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }
3422024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3432024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3442024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3452024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3462024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-18T19:44:31.552ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3492024-12-18T19:44:31.588ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-12-18T19:44:31.596ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone file = sled-storage/src/dataset.rs:302
3512024-12-18T19:44:31.734ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3943ba64-84f5-40ee-94de-ef33bd94d891 file = sled-storage/src/dataset.rs:388
3522024-12-18T19:44:31.742ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3532024-12-18T19:44:31.742ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3542024-12-18T19:44:31.742ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3552024-12-18T19:44:31.742ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3562024-12-18T19:44:31.742ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-12-18T19:44:31.753ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3582024-12-18T19:44:31.753ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c3612c32-5622-4a67-9ae3-29c036aec45e (zpool)
3592024-12-18T19:44:31.850ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }
3602024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3612024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3622024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3632024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3642024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-18T19:44:31.857ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3672024-12-18T19:44:31.891ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-12-18T19:44:31.899ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone file = sled-storage/src/dataset.rs:302
3692024-12-18T19:44:32.037ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c3612c32-5622-4a67-9ae3-29c036aec45e file = sled-storage/src/dataset.rs:388
3702024-12-18T19:44:32.045ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3712024-12-18T19:44:32.045ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3722024-12-18T19:44:32.045ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3732024-12-18T19:44:32.045ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3742024-12-18T19:44:32.045ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3752024-12-18T19:44:32.055ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3762024-12-18T19:44:32.055ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool)
3772024-12-18T19:44:32.157ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }
3782024-12-18T19:44:32.165ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3792024-12-18T19:44:32.165ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3802024-12-18T19:44:32.165ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3812024-12-18T19:44:32.165ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3822024-12-18T19:44:32.165ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832024-12-18T19:44:32.166ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-18T19:44:32.166ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3852024-12-18T19:44:32.169ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
3862024-12-18T19:44:32.201ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-18T19:44:32.209ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone file = sled-storage/src/dataset.rs:302
3882024-12-18T19:44:32.348ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6 file = sled-storage/src/dataset.rs:388
3892024-12-18T19:44:32.356ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-18T19:44:32.356ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-18T19:44:32.356ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-18T19:44:32.356ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-18T19:44:32.356ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-18T19:44:32.366ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-18T19:44:32.366ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool)
3962024-12-18T19:44:32.458ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }
3972024-12-18T19:44:32.464ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3982024-12-18T19:44:32.464ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3992024-12-18T19:44:32.464ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4002024-12-18T19:44:32.464ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4012024-12-18T19:44:32.465ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-18T19:44:32.465ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-18T19:44:32.465ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4042024-12-18T19:44:32.500ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-18T19:44:32.507ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone file = sled-storage/src/dataset.rs:302
4062024-12-18T19:44:32.658ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a file = sled-storage/src/dataset.rs:388
4072024-12-18T19:44:32.665ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4082024-12-18T19:44:32.665ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4092024-12-18T19:44:32.665ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4102024-12-18T19:44:32.666ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4112024-12-18T19:44:32.666ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4122024-12-18T19:44:32.675ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4132024-12-18T19:44:32.675ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 96909843-abb5-4785-acdb-8d286f18ea02 (zpool)
4142024-12-18T19:44:32.778ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }
4152024-12-18T19:44:32.786ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4162024-12-18T19:44:32.786ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4172024-12-18T19:44:32.786ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4182024-12-18T19:44:32.786ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4192024-12-18T19:44:32.786ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202024-12-18T19:44:32.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-18T19:44:32.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4222024-12-18T19:44:32.823ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4232024-12-18T19:44:32.831ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_96909843-abb5-4785-acdb-8d286f18ea02/crypt/zone file = sled-storage/src/dataset.rs:302
4242024-12-18T19:44:32.970ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_96909843-abb5-4785-acdb-8d286f18ea02 file = sled-storage/src/dataset.rs:388
4252024-12-18T19:44:32.978ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4262024-12-18T19:44:32.978ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4272024-12-18T19:44:32.978ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4282024-12-18T19:44:32.978ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f1657089-065e-4651-a353-e5d94949a179 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 78cecaad-9cc8-4539-b5e4-05d09d011c2d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4292024-12-18T19:44:32.978ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4302024-12-18T19:44:32.978ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4312024-12-18T19:44:32.978ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-12-18T19:44:32.978ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4332024-12-18T19:44:32.978ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4342024-12-18T19:44:32.978ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4352024-12-18T19:44:32.978ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4362024-12-18T19:44:32.978ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4372024-12-18T19:44:32.978ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4382024-12-18T19:44:32.978ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4392024-12-18T19:44:32.979ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4402024-12-18T19:44:32.979ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4412024-12-18T19:44:32.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3520261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42312 req_id = 80e05b57-9498-4a0e-9d30-70d87e04323a response_code = 200 uri = /omicron-physical-disks
4422024-12-18T19:44:33.010ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {03d6dbb7-4d64-4381-88b7-ccc50e9cc0e7 (dataset): DatasetConfig { id: 03d6dbb7-4d64-4381-88b7-ccc50e9cc0e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a34b159-d6af-4b06-abb2-fe4782cee463 (dataset): DatasetConfig { id: 0a34b159-d6af-4b06-abb2-fe4782cee463 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b242a5d-9878-4cb5-9081-dcbe0414774b (dataset): DatasetConfig { id: 0b242a5d-9878-4cb5-9081-dcbe0414774b (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fa5fe7c-def4-4d76-8cab-fe544f57409f (dataset): DatasetConfig { id: 0fa5fe7c-def4-4d76-8cab-fe544f57409f (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 14717c63-5a8b-41d5-a9fa-6fd858be2867 (dataset): DatasetConfig { id: 14717c63-5a8b-41d5-a9fa-6fd858be2867 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c934989-e7f3-4668-8c7c-a73ffa2c6f9c (dataset): DatasetConfig { id: 1c934989-e7f3-4668-8c7c-a73ffa2c6f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e62e166d-3195-4993-9658-25854943a145" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cf5f9a4-b68e-42e3-a398-03a066d4eab0 (dataset): DatasetConfig { id: 2cf5f9a4-b68e-42e3-a398-03a066d4eab0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31142ddf-6530-477e-91f0-9dfea7d83a01 (dataset): DatasetConfig { id: 31142ddf-6530-477e-91f0-9dfea7d83a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32f859cc-2a4e-4fef-93bb-ae1bd9b8737d (dataset): DatasetConfig { id: 32f859cc-2a4e-4fef-93bb-ae1bd9b8737d (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34940139-5833-498f-9aae-655aed33c9ff (dataset): DatasetConfig { id: 34940139-5833-498f-9aae-655aed33c9ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c1a3581-e863-46a2-8b82-9ba1639feccb (dataset): DatasetConfig { id: 3c1a3581-e863-46a2-8b82-9ba1639feccb (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3c76433a-c60a-4ff1-bbc5-bebec0cab43d (dataset): DatasetConfig { id: 3c76433a-c60a-4ff1-bbc5-bebec0cab43d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fb041eb-0612-4511-9431-4d52e8609e9b (dataset): DatasetConfig { id: 3fb041eb-0612-4511-9431-4d52e8609e9b (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40c5e685-1103-428d-925b-7b7c9f87117b (dataset): DatasetConfig { id: 40c5e685-1103-428d-925b-7b7c9f87117b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44eb739a-17be-40a2-9358-a36eb5424bbb (dataset): DatasetConfig { id: 44eb739a-17be-40a2-9358-a36eb5424bbb (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45af4d76-f508-4922-9c1c-c9691b800412 (dataset): DatasetConfig { id: 45af4d76-f508-4922-9c1c-c9691b800412 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48952d38-6687-48f2-8e78-da23236232c4 (dataset): DatasetConfig { id: 48952d38-6687-48f2-8e78-da23236232c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e513e45-569a-430e-a99b-d1cf3044bcdf (dataset): DatasetConfig { id: 4e513e45-569a-430e-a99b-d1cf3044bcdf (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4eb90ae2-5023-46ce-ae6f-b1de65ea5f0b (dataset): DatasetConfig { id: 4eb90ae2-5023-46ce-ae6f-b1de65ea5f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 512b39b2-11fe-43f7-9195-065a49742396 (dataset): DatasetConfig { id: 512b39b2-11fe-43f7-9195-065a49742396 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54fd1f24-f001-4d5f-a4df-99cf6ec9a937 (dataset): DatasetConfig { id: 54fd1f24-f001-4d5f-a4df-99cf6ec9a937 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59555d8e-82b0-433f-8bf1-dc5ae7565f03 (dataset): DatasetConfig { id: 59555d8e-82b0-433f-8bf1-dc5ae7565f03 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dc842ff-0576-40eb-a12d-6654734e035f (dataset): DatasetConfig { id: 5dc842ff-0576-40eb-a12d-6654734e035f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 786b403a-9e2c-40c1-b486-263c3fd15340 (dataset): DatasetConfig { id: 786b403a-9e2c-40c1-b486-263c3fd15340 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a57a477-0890-4eb4-9bf2-9baca7a25a3b (dataset): DatasetConfig { id: 7a57a477-0890-4eb4-9bf2-9baca7a25a3b (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e13bd26-2506-44ef-8d21-05579f638ecd (dataset): DatasetConfig { id: 7e13bd26-2506-44ef-8d21-05579f638ecd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ed859f8-79a3-43e7-8c68-f9dcae51c785 (dataset): DatasetConfig { id: 7ed859f8-79a3-43e7-8c68-f9dcae51c785 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 811dda3e-1fd5-4c70-8aea-187a3b37d3a7 (dataset): DatasetConfig { id: 811dda3e-1fd5-4c70-8aea-187a3b37d3a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81fbf0cd-efc6-4c8e-9088-2845a0a546b7 (dataset): DatasetConfig { id: 81fbf0cd-efc6-4c8e-9088-2845a0a546b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82518bad-38a7-4390-ba22-5f7db7ca7acd (dataset): DatasetConfig { id: 82518bad-38a7-4390-ba22-5f7db7ca7acd (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 879b3154-b385-4693-a7c0-50e05047659c (dataset): DatasetConfig { id: 879b3154-b385-4693-a7c0-50e05047659c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87e09ab6-e901-45d3-9ffb-bbe6e0a35f47 (dataset): DatasetConfig { id: 87e09ab6-e901-45d3-9ffb-bbe6e0a35f47 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89084305-3fde-4c61-9129-726c4f6e1f0d (dataset): DatasetConfig { id: 89084305-3fde-4c61-9129-726c4f6e1f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b7664a1-fd53-42e1-82ab-45868e36874a (dataset): DatasetConfig { id: 8b7664a1-fd53-42e1-82ab-45868e36874a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c1c0c6d-b7be-4395-aaa2-640d2c7b4a55 (dataset): DatasetConfig { id: 8c1c0c6d-b7be-4395-aaa2-640d2c7b4a55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d052b11-aabb-439f-a450-d41ce9a1a70f (dataset): DatasetConfig { id: 8d052b11-aabb-439f-a450-d41ce9a1a70f (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96dde58c-981d-4ffb-888a-701cf23b8ef4 (dataset): DatasetConfig { id: 96dde58c-981d-4ffb-888a-701cf23b8ef4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b784dc3-1d07-45ff-94eb-34c46e8c602a (dataset): DatasetConfig { id: 9b784dc3-1d07-45ff-94eb-34c46e8c602a (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c66bd8a-4693-4e88-819d-bba9721ef15a (dataset): DatasetConfig { id: 9c66bd8a-4693-4e88-819d-bba9721ef15a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fb0fa0f-3a55-49f2-a882-25b5ea6b23c6 (dataset): DatasetConfig { id: 9fb0fa0f-3a55-49f2-a882-25b5ea6b23c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0af59c9-511f-4450-a13e-47009979de0e (dataset): DatasetConfig { id: a0af59c9-511f-4450-a13e-47009979de0e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1e39fbc-7eaa-4f3f-b049-a5bc60be8d5c (dataset): DatasetConfig { id: a1e39fbc-7eaa-4f3f-b049-a5bc60be8d5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a294e6af-0efc-483d-904e-b3525b2513c9 (dataset): DatasetConfig { id: a294e6af-0efc-483d-904e-b3525b2513c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a49e94a5-a1e5-4ab7-ac23-ade41e371dac (dataset): DatasetConfig { id: a49e94a5-a1e5-4ab7-ac23-ade41e371dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a81fa1a6-4ab7-474c-9209-4a28f9b6b533 (dataset): DatasetConfig { id: a81fa1a6-4ab7-474c-9209-4a28f9b6b533 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa73e1f1-61cf-4d54-bcc8-7654e6661fc8 (dataset): DatasetConfig { id: aa73e1f1-61cf-4d54-bcc8-7654e6661fc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad519a9d-c9a9-464d-92e3-b54732434cf3 (dataset): DatasetConfig { id: ad519a9d-c9a9-464d-92e3-b54732434cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1fe2247-e0e7-4742-89f5-c69f5b1e5c4c (dataset): DatasetConfig { id: b1fe2247-e0e7-4742-89f5-c69f5b1e5c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8c61bdf-2ac7-48a1-9f0e-97ee6c79950a (dataset): DatasetConfig { id: b8c61bdf-2ac7-48a1-9f0e-97ee6c79950a (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bac944f7-99d2-4b8e-bbea-840c00c63a88 (dataset): DatasetConfig { id: bac944f7-99d2-4b8e-bbea-840c00c63a88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc2682f-8bb8-433f-b0b4-b08833922043 (dataset): DatasetConfig { id: bcc2682f-8bb8-433f-b0b4-b08833922043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bd7a6d34-e046-43c6-b9fe-ce599fb48959 (dataset): DatasetConfig { id: bd7a6d34-e046-43c6-b9fe-ce599fb48959 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0a373f5-b134-4925-a38a-91fb93246753 (dataset): DatasetConfig { id: c0a373f5-b134-4925-a38a-91fb93246753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c30c216a-7e5d-4aa2-8ee3-88385e43abdc (dataset): DatasetConfig { id: c30c216a-7e5d-4aa2-8ee3-88385e43abdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3975710-51ea-483c-9b52-10b3f94fa690 (dataset): DatasetConfig { id: c3975710-51ea-483c-9b52-10b3f94fa690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca04d0d8-363d-46fd-b197-c147ce157d04 (dataset): DatasetConfig { id: ca04d0d8-363d-46fd-b197-c147ce157d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d010eb48-231f-4885-aadb-e1406aa38d39 (dataset): DatasetConfig { id: d010eb48-231f-4885-aadb-e1406aa38d39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c2d48c-1f5d-4df2-8fdb-3a3cff9ee20c (dataset): DatasetConfig { id: d0c2d48c-1f5d-4df2-8fdb-3a3cff9ee20c (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d61dd0f5-ec08-44d0-927e-4680e46af88c (dataset): DatasetConfig { id: d61dd0f5-ec08-44d0-927e-4680e46af88c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc0c89f2-e5f4-4cbb-ab1a-fe60416063ed (dataset): DatasetConfig { id: dc0c89f2-e5f4-4cbb-ab1a-fe60416063ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfcbe23d-9127-4a6a-a98e-ccd4a9a67d1c (dataset): DatasetConfig { id: dfcbe23d-9127-4a6a-a98e-ccd4a9a67d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e788ba57-4ef3-49fd-bf66-0ea7de8754db (dataset): DatasetConfig { id: e788ba57-4ef3-49fd-bf66-0ea7de8754db (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9b65573-4559-4533-a16a-f4b25032fae7 (dataset): DatasetConfig { id: e9b65573-4559-4533-a16a-f4b25032fae7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea31fe84-f9e5-47ce-b955-844a286d902a (dataset): DatasetConfig { id: ea31fe84-f9e5-47ce-b955-844a286d902a (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2cba039-d09d-4602-8b14-b32dd965d68d (dataset): DatasetConfig { id: f2cba039-d09d-4602-8b14-b32dd965d68d (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f40da0dd-1fcf-4a69-b51d-0aa41d5dd29a (dataset): DatasetConfig { id: f40da0dd-1fcf-4a69-b51d-0aa41d5dd29a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4432024-12-18T19:44:33.010ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61075
4442024-12-18T19:44:33.011ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4452024-12-18T19:44:33.011ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {03d6dbb7-4d64-4381-88b7-ccc50e9cc0e7 (dataset): DatasetConfig { id: 03d6dbb7-4d64-4381-88b7-ccc50e9cc0e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0a34b159-d6af-4b06-abb2-fe4782cee463 (dataset): DatasetConfig { id: 0a34b159-d6af-4b06-abb2-fe4782cee463 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b242a5d-9878-4cb5-9081-dcbe0414774b (dataset): DatasetConfig { id: 0b242a5d-9878-4cb5-9081-dcbe0414774b (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0fa5fe7c-def4-4d76-8cab-fe544f57409f (dataset): DatasetConfig { id: 0fa5fe7c-def4-4d76-8cab-fe544f57409f (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 14717c63-5a8b-41d5-a9fa-6fd858be2867 (dataset): DatasetConfig { id: 14717c63-5a8b-41d5-a9fa-6fd858be2867 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c934989-e7f3-4668-8c7c-a73ffa2c6f9c (dataset): DatasetConfig { id: 1c934989-e7f3-4668-8c7c-a73ffa2c6f9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e62e166d-3195-4993-9658-25854943a145" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2cf5f9a4-b68e-42e3-a398-03a066d4eab0 (dataset): DatasetConfig { id: 2cf5f9a4-b68e-42e3-a398-03a066d4eab0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31142ddf-6530-477e-91f0-9dfea7d83a01 (dataset): DatasetConfig { id: 31142ddf-6530-477e-91f0-9dfea7d83a01 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32f859cc-2a4e-4fef-93bb-ae1bd9b8737d (dataset): DatasetConfig { id: 32f859cc-2a4e-4fef-93bb-ae1bd9b8737d (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 34940139-5833-498f-9aae-655aed33c9ff (dataset): DatasetConfig { id: 34940139-5833-498f-9aae-655aed33c9ff (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c1a3581-e863-46a2-8b82-9ba1639feccb (dataset): DatasetConfig { id: 3c1a3581-e863-46a2-8b82-9ba1639feccb (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3c76433a-c60a-4ff1-bbc5-bebec0cab43d (dataset): DatasetConfig { id: 3c76433a-c60a-4ff1-bbc5-bebec0cab43d (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3fb041eb-0612-4511-9431-4d52e8609e9b (dataset): DatasetConfig { id: 3fb041eb-0612-4511-9431-4d52e8609e9b (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 40c5e685-1103-428d-925b-7b7c9f87117b (dataset): DatasetConfig { id: 40c5e685-1103-428d-925b-7b7c9f87117b (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44eb739a-17be-40a2-9358-a36eb5424bbb (dataset): DatasetConfig { id: 44eb739a-17be-40a2-9358-a36eb5424bbb (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 45af4d76-f508-4922-9c1c-c9691b800412 (dataset): DatasetConfig { id: 45af4d76-f508-4922-9c1c-c9691b800412 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 48952d38-6687-48f2-8e78-da23236232c4 (dataset): DatasetConfig { id: 48952d38-6687-48f2-8e78-da23236232c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e513e45-569a-430e-a99b-d1cf3044bcdf (dataset): DatasetConfig { id: 4e513e45-569a-430e-a99b-d1cf3044bcdf (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4eb90ae2-5023-46ce-ae6f-b1de65ea5f0b (dataset): DatasetConfig { id: 4eb90ae2-5023-46ce-ae6f-b1de65ea5f0b (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 512b39b2-11fe-43f7-9195-065a49742396 (dataset): DatasetConfig { id: 512b39b2-11fe-43f7-9195-065a49742396 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 54fd1f24-f001-4d5f-a4df-99cf6ec9a937 (dataset): DatasetConfig { id: 54fd1f24-f001-4d5f-a4df-99cf6ec9a937 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59555d8e-82b0-433f-8bf1-dc5ae7565f03 (dataset): DatasetConfig { id: 59555d8e-82b0-433f-8bf1-dc5ae7565f03 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5dc842ff-0576-40eb-a12d-6654734e035f (dataset): DatasetConfig { id: 5dc842ff-0576-40eb-a12d-6654734e035f (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 786b403a-9e2c-40c1-b486-263c3fd15340 (dataset): DatasetConfig { id: 786b403a-9e2c-40c1-b486-263c3fd15340 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a57a477-0890-4eb4-9bf2-9baca7a25a3b (dataset): DatasetConfig { id: 7a57a477-0890-4eb4-9bf2-9baca7a25a3b (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e13bd26-2506-44ef-8d21-05579f638ecd (dataset): DatasetConfig { id: 7e13bd26-2506-44ef-8d21-05579f638ecd (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ed859f8-79a3-43e7-8c68-f9dcae51c785 (dataset): DatasetConfig { id: 7ed859f8-79a3-43e7-8c68-f9dcae51c785 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 811dda3e-1fd5-4c70-8aea-187a3b37d3a7 (dataset): DatasetConfig { id: 811dda3e-1fd5-4c70-8aea-187a3b37d3a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 81fbf0cd-efc6-4c8e-9088-2845a0a546b7 (dataset): DatasetConfig { id: 81fbf0cd-efc6-4c8e-9088-2845a0a546b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82518bad-38a7-4390-ba22-5f7db7ca7acd (dataset): DatasetConfig { id: 82518bad-38a7-4390-ba22-5f7db7ca7acd (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 879b3154-b385-4693-a7c0-50e05047659c (dataset): DatasetConfig { id: 879b3154-b385-4693-a7c0-50e05047659c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 87e09ab6-e901-45d3-9ffb-bbe6e0a35f47 (dataset): DatasetConfig { id: 87e09ab6-e901-45d3-9ffb-bbe6e0a35f47 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 89084305-3fde-4c61-9129-726c4f6e1f0d (dataset): DatasetConfig { id: 89084305-3fde-4c61-9129-726c4f6e1f0d (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b7664a1-fd53-42e1-82ab-45868e36874a (dataset): DatasetConfig { id: 8b7664a1-fd53-42e1-82ab-45868e36874a (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8c1c0c6d-b7be-4395-aaa2-640d2c7b4a55 (dataset): DatasetConfig { id: 8c1c0c6d-b7be-4395-aaa2-640d2c7b4a55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d052b11-aabb-439f-a450-d41ce9a1a70f (dataset): DatasetConfig { id: 8d052b11-aabb-439f-a450-d41ce9a1a70f (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96dde58c-981d-4ffb-888a-701cf23b8ef4 (dataset): DatasetConfig { id: 96dde58c-981d-4ffb-888a-701cf23b8ef4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9b784dc3-1d07-45ff-94eb-34c46e8c602a (dataset): DatasetConfig { id: 9b784dc3-1d07-45ff-94eb-34c46e8c602a (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9c66bd8a-4693-4e88-819d-bba9721ef15a (dataset): DatasetConfig { id: 9c66bd8a-4693-4e88-819d-bba9721ef15a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9fb0fa0f-3a55-49f2-a882-25b5ea6b23c6 (dataset): DatasetConfig { id: 9fb0fa0f-3a55-49f2-a882-25b5ea6b23c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0af59c9-511f-4450-a13e-47009979de0e (dataset): DatasetConfig { id: a0af59c9-511f-4450-a13e-47009979de0e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1e39fbc-7eaa-4f3f-b049-a5bc60be8d5c (dataset): DatasetConfig { id: a1e39fbc-7eaa-4f3f-b049-a5bc60be8d5c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a294e6af-0efc-483d-904e-b3525b2513c9 (dataset): DatasetConfig { id: a294e6af-0efc-483d-904e-b3525b2513c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a49e94a5-a1e5-4ab7-ac23-ade41e371dac (dataset): DatasetConfig { id: a49e94a5-a1e5-4ab7-ac23-ade41e371dac (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a81fa1a6-4ab7-474c-9209-4a28f9b6b533 (dataset): DatasetConfig { id: a81fa1a6-4ab7-474c-9209-4a28f9b6b533 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa73e1f1-61cf-4d54-bcc8-7654e6661fc8 (dataset): DatasetConfig { id: aa73e1f1-61cf-4d54-bcc8-7654e6661fc8 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ad519a9d-c9a9-464d-92e3-b54732434cf3 (dataset): DatasetConfig { id: ad519a9d-c9a9-464d-92e3-b54732434cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1fe2247-e0e7-4742-89f5-c69f5b1e5c4c (dataset): DatasetConfig { id: b1fe2247-e0e7-4742-89f5-c69f5b1e5c4c (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8c61bdf-2ac7-48a1-9f0e-97ee6c79950a (dataset): DatasetConfig { id: b8c61bdf-2ac7-48a1-9f0e-97ee6c79950a (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bac944f7-99d2-4b8e-bbea-840c00c63a88 (dataset): DatasetConfig { id: bac944f7-99d2-4b8e-bbea-840c00c63a88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bcc2682f-8bb8-433f-b0b4-b08833922043 (dataset): DatasetConfig { id: bcc2682f-8bb8-433f-b0b4-b08833922043 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bd7a6d34-e046-43c6-b9fe-ce599fb48959 (dataset): DatasetConfig { id: bd7a6d34-e046-43c6-b9fe-ce599fb48959 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0a373f5-b134-4925-a38a-91fb93246753 (dataset): DatasetConfig { id: c0a373f5-b134-4925-a38a-91fb93246753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c30c216a-7e5d-4aa2-8ee3-88385e43abdc (dataset): DatasetConfig { id: c30c216a-7e5d-4aa2-8ee3-88385e43abdc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3975710-51ea-483c-9b52-10b3f94fa690 (dataset): DatasetConfig { id: c3975710-51ea-483c-9b52-10b3f94fa690 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca04d0d8-363d-46fd-b197-c147ce157d04 (dataset): DatasetConfig { id: ca04d0d8-363d-46fd-b197-c147ce157d04 (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d010eb48-231f-4885-aadb-e1406aa38d39 (dataset): DatasetConfig { id: d010eb48-231f-4885-aadb-e1406aa38d39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d0c2d48c-1f5d-4df2-8fdb-3a3cff9ee20c (dataset): DatasetConfig { id: d0c2d48c-1f5d-4df2-8fdb-3a3cff9ee20c (dataset), name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d61dd0f5-ec08-44d0-927e-4680e46af88c (dataset): DatasetConfig { id: d61dd0f5-ec08-44d0-927e-4680e46af88c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc0c89f2-e5f4-4cbb-ab1a-fe60416063ed (dataset): DatasetConfig { id: dc0c89f2-e5f4-4cbb-ab1a-fe60416063ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dfcbe23d-9127-4a6a-a98e-ccd4a9a67d1c (dataset): DatasetConfig { id: dfcbe23d-9127-4a6a-a98e-ccd4a9a67d1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e788ba57-4ef3-49fd-bf66-0ea7de8754db (dataset): DatasetConfig { id: e788ba57-4ef3-49fd-bf66-0ea7de8754db (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9b65573-4559-4533-a16a-f4b25032fae7 (dataset): DatasetConfig { id: e9b65573-4559-4533-a16a-f4b25032fae7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ea31fe84-f9e5-47ce-b955-844a286d902a (dataset): DatasetConfig { id: ea31fe84-f9e5-47ce-b955-844a286d902a (dataset), name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2cba039-d09d-4602-8b14-b32dd965d68d (dataset): DatasetConfig { id: f2cba039-d09d-4602-8b14-b32dd965d68d (dataset), name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f40da0dd-1fcf-4a69-b51d-0aa41d5dd29a (dataset): DatasetConfig { id: f40da0dd-1fcf-4a69-b51d-0aa41d5dd29a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4462024-12-18T19:44:33.011ZINFOSledAgent (StorageManager): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472024-12-18T19:44:33.011ZINFOSledAgent (StorageManager): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-18T19:44:33.011ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4492024-12-18T19:44:33.027ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4502024-12-18T19:44:33.027ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4512024-12-18T19:44:33.027ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible" } file = sled-storage/src/manager.rs:1431
4522024-12-18T19:44:33.081ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532024-12-18T19:44:33.081ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4542024-12-18T19:44:33.081ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a" } file = sled-storage/src/manager.rs:1431
4552024-12-18T19:44:33.140ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562024-12-18T19:44:33.140ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4572024-12-18T19:44:33.140ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4582024-12-18T19:44:33.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592024-12-18T19:44:33.171ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4602024-12-18T19:44:33.171ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/debug"), full_name: "oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/debug" } file = sled-storage/src/manager.rs:1431
4612024-12-18T19:44:33.175ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
4622024-12-18T19:44:33.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632024-12-18T19:44:33.202ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642024-12-18T19:44:33.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade" } file = sled-storage/src/manager.rs:1431
4652024-12-18T19:44:33.268ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662024-12-18T19:44:33.268ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672024-12-18T19:44:33.268ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_crucible_e62e166d-3195-4993-9658-25854943a145"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_crucible_e62e166d-3195-4993-9658-25854943a145" } file = sled-storage/src/manager.rs:1431
4682024-12-18T19:44:33.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692024-12-18T19:44:33.330ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702024-12-18T19:44:33.330ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5" } file = sled-storage/src/manager.rs:1431
4712024-12-18T19:44:33.391ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722024-12-18T19:44:33.391ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732024-12-18T19:44:33.391ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3" } file = sled-storage/src/manager.rs:1431
4742024-12-18T19:44:33.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752024-12-18T19:44:33.453ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762024-12-18T19:44:33.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388" } file = sled-storage/src/manager.rs:1431
4772024-12-18T19:44:33.514ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782024-12-18T19:44:33.514ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4792024-12-18T19:44:33.514ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4802024-12-18T19:44:33.566ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812024-12-18T19:44:33.566ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4822024-12-18T19:44:33.566ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/debug"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/debug" } file = sled-storage/src/manager.rs:1431
4832024-12-18T19:44:33.603ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842024-12-18T19:44:33.603ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4852024-12-18T19:44:33.603ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone" } file = sled-storage/src/manager.rs:1431
4862024-12-18T19:44:33.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872024-12-18T19:44:33.633ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4882024-12-18T19:44:33.633ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone"), full_name: "oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone" } file = sled-storage/src/manager.rs:1431
4892024-12-18T19:44:33.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902024-12-18T19:44:33.665ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912024-12-18T19:44:33.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4922024-12-18T19:44:33.715ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932024-12-18T19:44:33.716ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942024-12-18T19:44:33.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone/oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47"), full_name: "oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone/oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47" } file = sled-storage/src/manager.rs:1431
4952024-12-18T19:44:33.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962024-12-18T19:44:33.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972024-12-18T19:44:33.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04" } file = sled-storage/src/manager.rs:1431
4982024-12-18T19:44:33.836ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992024-12-18T19:44:33.836ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5002024-12-18T19:44:33.836ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/debug"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/debug" } file = sled-storage/src/manager.rs:1431
5012024-12-18T19:44:33.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022024-12-18T19:44:33.866ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032024-12-18T19:44:33.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/zone/oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2" } file = sled-storage/src/manager.rs:1431
5042024-12-18T19:44:33.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052024-12-18T19:44:33.926ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062024-12-18T19:44:33.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crucible" } file = sled-storage/src/manager.rs:1431
5072024-12-18T19:44:33.975ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082024-12-18T19:44:33.975ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092024-12-18T19:44:33.975ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02" } file = sled-storage/src/manager.rs:1431
5102024-12-18T19:44:34.037ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112024-12-18T19:44:34.037ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122024-12-18T19:44:34.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crucible" } file = sled-storage/src/manager.rs:1431
5132024-12-18T19:44:34.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142024-12-18T19:44:34.087ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152024-12-18T19:44:34.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone/oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344"), full_name: "oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone/oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344" } file = sled-storage/src/manager.rs:1431
5162024-12-18T19:44:34.150ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172024-12-18T19:44:34.150ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5182024-12-18T19:44:34.150ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160" } file = sled-storage/src/manager.rs:1431
5192024-12-18T19:44:34.177ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
5202024-12-18T19:44:34.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212024-12-18T19:44:34.211ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5222024-12-18T19:44:34.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5232024-12-18T19:44:34.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242024-12-18T19:44:34.241ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252024-12-18T19:44:34.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5262024-12-18T19:44:34.292ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272024-12-18T19:44:34.292ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282024-12-18T19:44:34.292ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crucible" } file = sled-storage/src/manager.rs:1431
5292024-12-18T19:44:34.340ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302024-12-18T19:44:34.340ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312024-12-18T19:44:34.340ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crucible" } file = sled-storage/src/manager.rs:1431
5322024-12-18T19:44:34.389ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332024-12-18T19:44:34.389ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5342024-12-18T19:44:34.389ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/debug"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/debug" } file = sled-storage/src/manager.rs:1431
5352024-12-18T19:44:34.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362024-12-18T19:44:34.419ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372024-12-18T19:44:34.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06" } file = sled-storage/src/manager.rs:1431
5382024-12-18T19:44:34.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392024-12-18T19:44:34.480ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402024-12-18T19:44:34.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_96909843-abb5-4785-acdb-8d286f18ea02/crucible" } file = sled-storage/src/manager.rs:1431
5412024-12-18T19:44:34.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422024-12-18T19:44:34.527ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432024-12-18T19:44:34.527ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crucible" } file = sled-storage/src/manager.rs:1431
5442024-12-18T19:44:34.576ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452024-12-18T19:44:34.576ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462024-12-18T19:44:34.576ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09" } file = sled-storage/src/manager.rs:1431
5472024-12-18T19:44:34.639ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482024-12-18T19:44:34.639ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492024-12-18T19:44:34.639ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crucible" } file = sled-storage/src/manager.rs:1431
5502024-12-18T19:44:34.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512024-12-18T19:44:34.689ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522024-12-18T19:44:34.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5532024-12-18T19:44:34.716ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 18.672913987s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
5542024-12-18T19:44:34.739ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552024-12-18T19:44:34.739ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562024-12-18T19:44:34.739ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0" } file = sled-storage/src/manager.rs:1431
5572024-12-18T19:44:34.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582024-12-18T19:44:34.800ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592024-12-18T19:44:34.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798" } file = sled-storage/src/manager.rs:1431
5602024-12-18T19:44:34.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612024-12-18T19:44:34.860ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5622024-12-18T19:44:34.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/debug"), full_name: "oxp_415023e8-4b60-4f50-85ce-5d337214083f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5632024-12-18T19:44:34.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642024-12-18T19:44:34.891ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652024-12-18T19:44:34.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone/oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f" } file = sled-storage/src/manager.rs:1431
5662024-12-18T19:44:34.954ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672024-12-18T19:44:34.954ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5682024-12-18T19:44:34.954ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone" } file = sled-storage/src/manager.rs:1431
5692024-12-18T19:44:34.984ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702024-12-18T19:44:34.984ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712024-12-18T19:44:34.984ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5722024-12-18T19:44:35.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732024-12-18T19:44:35.034ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742024-12-18T19:44:35.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe" } file = sled-storage/src/manager.rs:1431
5752024-12-18T19:44:35.093ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762024-12-18T19:44:35.093ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772024-12-18T19:44:35.093ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/debug"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/debug" } file = sled-storage/src/manager.rs:1431
5782024-12-18T19:44:35.124ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792024-12-18T19:44:35.124ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802024-12-18T19:44:35.124ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77" } file = sled-storage/src/manager.rs:1431
5812024-12-18T19:44:35.179ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
5822024-12-18T19:44:35.185ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832024-12-18T19:44:35.185ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5842024-12-18T19:44:35.185ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/debug"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/debug" } file = sled-storage/src/manager.rs:1431
5852024-12-18T19:44:35.215ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862024-12-18T19:44:35.215ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5872024-12-18T19:44:35.215ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0" } file = sled-storage/src/manager.rs:1431
5882024-12-18T19:44:35.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892024-12-18T19:44:35.276ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5902024-12-18T19:44:35.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/debug"), full_name: "oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5912024-12-18T19:44:35.306ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922024-12-18T19:44:35.306ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5932024-12-18T19:44:35.306ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone/oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d"), full_name: "oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/zone/oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d" } file = sled-storage/src/manager.rs:1431
5942024-12-18T19:44:35.367ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952024-12-18T19:44:35.367ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962024-12-18T19:44:35.367ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5972024-12-18T19:44:35.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982024-12-18T19:44:35.416ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5992024-12-18T19:44:35.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone/oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70"), full_name: "oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone/oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70" } file = sled-storage/src/manager.rs:1431
6002024-12-18T19:44:35.477ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012024-12-18T19:44:35.477ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6022024-12-18T19:44:35.477ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6032024-12-18T19:44:35.529ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042024-12-18T19:44:35.529ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052024-12-18T19:44:35.529ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96909843-abb5-4785-acdb-8d286f18ea02/crypt/debug"), full_name: "oxp_96909843-abb5-4785-acdb-8d286f18ea02/crypt/debug" } file = sled-storage/src/manager.rs:1431
6062024-12-18T19:44:35.558ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072024-12-18T19:44:35.558ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6082024-12-18T19:44:35.558ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96909843-abb5-4785-acdb-8d286f18ea02/crypt/zone"), full_name: "oxp_96909843-abb5-4785-acdb-8d286f18ea02/crypt/zone" } file = sled-storage/src/manager.rs:1431
6092024-12-18T19:44:35.588ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102024-12-18T19:44:35.588ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112024-12-18T19:44:35.588ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6122024-12-18T19:44:35.637ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132024-12-18T19:44:35.637ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142024-12-18T19:44:35.637ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crucible" } file = sled-storage/src/manager.rs:1431
6152024-12-18T19:44:35.685ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162024-12-18T19:44:35.685ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172024-12-18T19:44:35.685ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone/oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a" } file = sled-storage/src/manager.rs:1431
6182024-12-18T19:44:35.745ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192024-12-18T19:44:35.745ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6202024-12-18T19:44:35.745ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/zone" } file = sled-storage/src/manager.rs:1431
6212024-12-18T19:44:35.775ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222024-12-18T19:44:35.775ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232024-12-18T19:44:35.775ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/96909843-abb5-4785-acdb-8d286f18ea02/crypt/zone/oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446"), full_name: "oxp_96909843-abb5-4785-acdb-8d286f18ea02/crypt/zone/oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446" } file = sled-storage/src/manager.rs:1431
6242024-12-18T19:44:35.834ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252024-12-18T19:44:35.834ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6262024-12-18T19:44:35.834ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone"), full_name: "oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/zone" } file = sled-storage/src/manager.rs:1431
6272024-12-18T19:44:35.864ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282024-12-18T19:44:35.864ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6292024-12-18T19:44:35.864ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone"), full_name: "oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crypt/zone" } file = sled-storage/src/manager.rs:1431
6302024-12-18T19:44:35.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312024-12-18T19:44:35.894ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322024-12-18T19:44:35.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6332024-12-18T19:44:35.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342024-12-18T19:44:35.945ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352024-12-18T19:44:35.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6362024-12-18T19:44:35.994ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372024-12-18T19:44:35.994ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382024-12-18T19:44:35.994ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667" } file = sled-storage/src/manager.rs:1431
6392024-12-18T19:44:36.055ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402024-12-18T19:44:36.055ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412024-12-18T19:44:36.055ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), full_name: "oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/zone/oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b" } file = sled-storage/src/manager.rs:1431
6422024-12-18T19:44:36.115ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432024-12-18T19:44:36.115ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442024-12-18T19:44:36.115ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6452024-12-18T19:44:36.165ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462024-12-18T19:44:36.165ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472024-12-18T19:44:36.165ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8"), full_name: "oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/zone/oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8" } file = sled-storage/src/manager.rs:1431
6482024-12-18T19:44:36.181ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
6492024-12-18T19:44:36.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502024-12-18T19:44:36.225ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6512024-12-18T19:44:36.225ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31"), full_name: "oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/zone/oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31" } file = sled-storage/src/manager.rs:1431
6522024-12-18T19:44:36.285ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6532024-12-18T19:44:36.286ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6542024-12-18T19:44:36.286ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
6552024-12-18T19:44:36.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3275737 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61075 req_id = bf85dbc2-8dab-449a-a97b-9b7e581ae04a response_code = 200 uri = /datasets
6562024-12-18T19:44:36.318ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 73c17a86-f1fb-4102-92b8-0059f9ce4d77 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89d5399b-5669-48fc-9549-d301f3010160 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 967a5ab6-9437-47ac-b51c-7113605783e5 (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6572024-12-18T19:44:36.318ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36228
6582024-12-18T19:44:36.318ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592024-12-18T19:44:36.318ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602024-12-18T19:44:36.327ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612024-12-18T19:44:36.327ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622024-12-18T19:44:36.336ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632024-12-18T19:44:36.336ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642024-12-18T19:44:36.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652024-12-18T19:44:36.345ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:188
6662024-12-18T19:44:36.345ZINFOSledAgent (ServiceManager): No ledger in /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:188
6672024-12-18T19:44:36.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682024-12-18T19:44:36.388ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692024-12-18T19:44:36.388ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702024-12-18T19:44:36.388ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712024-12-18T19:44:36.441ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5 file = illumos-utils/src/zone.rs:325
6722024-12-18T19:44:36.445ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160 file = illumos-utils/src/zone.rs:325
6732024-12-18T19:44:36.449ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77 file = illumos-utils/src/zone.rs:325
6742024-12-18T19:44:36.462ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5 file = illumos-utils/src/zone.rs:363
6752024-12-18T19:44:36.466ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160 file = illumos-utils/src/zone.rs:363
6762024-12-18T19:44:36.470ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77 file = illumos-utils/src/zone.rs:363
6772024-12-18T19:44:37.183ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
6782024-12-18T19:44:38.075ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792024-12-18T19:44:38.075ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6802024-12-18T19:44:38.075ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
6812024-12-18T19:44:38.560ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6822024-12-18T19:44:38.874ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
6832024-12-18T19:44:38.874ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
6842024-12-18T19:44:39.039ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6852024-12-18T19:44:39.039ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6862024-12-18T19:44:39.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 58.17569ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
6872024-12-18T19:44:39.047ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6882024-12-18T19:44:39.047ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
6892024-12-18T19:44:39.052ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
6902024-12-18T19:44:39.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 84.994133ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
6912024-12-18T19:44:39.117ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
6922024-12-18T19:44:39.117ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
6932024-12-18T19:44:39.124ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
6942024-12-18T19:44:39.124ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
6952024-12-18T19:44:39.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 72.772913ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
6962024-12-18T19:44:39.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 63.876513ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
6972024-12-18T19:44:39.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 184.536066ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
6982024-12-18T19:44:39.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 111.611289ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
6992024-12-18T19:44:39.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 52.584946ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7002024-12-18T19:44:39.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 243.498014ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7012024-12-18T19:44:39.542ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
7022024-12-18T19:44:39.542ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
7032024-12-18T19:44:39.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 158.158874ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7042024-12-18T19:44:39.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 120.644332ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7052024-12-18T19:44:39.705ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
7062024-12-18T19:44:39.705ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
7072024-12-18T19:44:39.762ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
7082024-12-18T19:44:39.762ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
7092024-12-18T19:44:39.787ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
7102024-12-18T19:44:39.787ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
7112024-12-18T19:44:39.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 800.936534ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7122024-12-18T19:44:39.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 230.949137ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7132024-12-18T19:44:39.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 435.675948ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7142024-12-18T19:44:39.873ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
7152024-12-18T19:44:39.873ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
7162024-12-18T19:44:39.969ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
7172024-12-18T19:44:39.969ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7182024-12-18T19:44:40.002ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7192024-12-18T19:44:40.038ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7202024-12-18T19:44:40.038ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7212024-12-18T19:44:40.039ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 2
7222024-12-18T19:44:40.039ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7232024-12-18T19:44:40.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 750.855022ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7242024-12-18T19:44:40.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
7252024-12-18T19:44:40.133ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7262024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7272024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7282024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7292024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7302024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7312024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7322024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7332024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7342024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7352024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7362024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7372024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7382024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7392024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7402024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7412024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7422024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7432024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7442024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7452024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7462024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7472024-12-18T19:44:40.133ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7482024-12-18T19:44:40.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 408.23303ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7492024-12-18T19:44:40.295ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
7502024-12-18T19:44:40.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
7512024-12-18T19:44:40.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 1.144014467s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7522024-12-18T19:44:40.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 1.291650923s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7532024-12-18T19:44:40.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 804.395583ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7542024-12-18T19:44:41.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 1.2606495s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7552024-12-18T19:44:41.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 830.063603ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7562024-12-18T19:44:41.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 1.245126175s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7572024-12-18T19:44:42.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 854.575715ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7582024-12-18T19:44:42.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 953.685042ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7592024-12-18T19:44:43.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 562.935187ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7602024-12-18T19:44:43.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77") failed: Property not found. retry in 1.107060728s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7612024-12-18T19:44:43.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160") failed: Property not found. retry in 737.622502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7622024-12-18T19:44:43.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5") failed: Property not found. retry in 775.788287ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7632024-12-18T19:44:44.648ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_967a5ab6-9437-47ac-b51c-7113605783e5
7642024-12-18T19:44:44.648ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_89d5399b-5669-48fc-9549-d301f3010160
7652024-12-18T19:44:44.648ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_73c17a86-f1fb-4102-92b8-0059f9ce4d77
7662024-12-18T19:44:44.648ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672024-12-18T19:44:44.648ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682024-12-18T19:44:44.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8330093 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36228 req_id = 9826b815-375f-4640-8c30-1e56c785a683 response_code = 204 uri = /omicron-zones
7692024-12-18T19:44:44.650ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702024-12-18T19:44:44.681ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 56.245455ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712024-12-18T19:44:44.761ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722024-12-18T19:44:45.939ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732024-12-18T19:44:45.987ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742024-12-18T19:44:45.987ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752024-12-18T19:44:46.019ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762024-12-18T19:44:46.019ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772024-12-18T19:44:46.019ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782024-12-18T19:44:46.049ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 73c17a86-f1fb-4102-92b8-0059f9ce4d77 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89d5399b-5669-48fc-9549-d301f3010160 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 967a5ab6-9437-47ac-b51c-7113605783e5 (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 (service), filesystem_pool: Some(ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cff37dfe-fdfd-4aa8-b0a0-761c65f1ab7f, kind: Service { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 }, name: Name("ntp-8c9f32d3-0bf2-4a33-8eb6-a810d5021be0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 176])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792024-12-18T19:44:46.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48568
7802024-12-18T19:44:46.049ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812024-12-18T19:44:46.049ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-12-18T19:44:46.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832024-12-18T19:44:46.059ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-12-18T19:44:46.069ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852024-12-18T19:44:46.069ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862024-12-18T19:44:46.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872024-12-18T19:44:46.079ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
7882024-12-18T19:44:46.079ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
7892024-12-18T19:44:46.080ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902024-12-18T19:44:46.091ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912024-12-18T19:44:46.123ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922024-12-18T19:44:46.124ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932024-12-18T19:44:46.124ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942024-12-18T19:44:46.153ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 166, 176]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952024-12-18T19:44:46.153ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7962024-12-18T19:44:46.154ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7972024-12-18T19:44:46.154ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7982024-12-18T19:44:46.154ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7992024-12-18T19:44:46.155ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002024-12-18T19:44:46.179ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 file = illumos-utils/src/zone.rs:325
8012024-12-18T19:44:46.198ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 file = illumos-utils/src/zone.rs:363
8022024-12-18T19:44:46.800ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032024-12-18T19:44:46.800ZINFOSledAgent (ServiceManager): Booting oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8042024-12-18T19:44:46.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 66.642746ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8052024-12-18T19:44:47.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 51.769312ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8062024-12-18T19:44:47.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 135.723584ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8072024-12-18T19:44:47.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 473.053165ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8082024-12-18T19:44:47.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 878.350939ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8092024-12-18T19:44:48.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 507.239052ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8102024-12-18T19:44:48.877ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8112024-12-18T19:44:48.877ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8122024-12-18T19:44:49.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 518.541191ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8132024-12-18T19:44:49.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 578.346481ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8142024-12-18T19:44:50.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 1.039733592s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8152024-12-18T19:44:50.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8162024-12-18T19:44:50.297ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8172024-12-18T19:44:51.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0") failed: Property not found. retry in 889.46604ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8182024-12-18T19:44:52.189ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0
8192024-12-18T19:44:52.189ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202024-12-18T19:44:52.189ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212024-12-18T19:44:52.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6140857 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48568 req_id = b062014e-b19e-4d6a-a6a2-3a55e3b69c1e response_code = 204 uri = /omicron-zones
8222024-12-18T19:44:52.192ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232024-12-18T19:44:52.222ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242024-12-18T19:44:52.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36626
8252024-12-18T19:44:52.230ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8262024-12-18T19:44:52.230ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 7881 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36626 req_id = 561d69fa-a5cc-4ca4-8c41-3f9a1e2b661a response_code = 500 uri = /timesync
8272024-12-18T19:44:52.232ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282024-12-18T19:44:52.330ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292024-12-18T19:44:52.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62728
8302024-12-18T19:44:54.577ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8312024-12-18T19:44:54.581ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8322024-12-18T19:44:54.650ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8332024-12-18T19:44:56.340ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8342024-12-18T19:44:56.340ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62728 req_id = b6b62cfa-4392-4e96-8ad8-a983c2ebc08a response_code = 500 uri = /timesync
8352024-12-18T19:44:56.342ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362024-12-18T19:44:56.468ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372024-12-18T19:44:56.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58699
8382024-12-18T19:44:56.477ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8392024-12-18T19:44:56.477ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8788 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58699 req_id = 231c20f2-6da9-4a91-804e-b60a5f75b2d9 response_code = 500 uri = /timesync
8402024-12-18T19:44:56.480ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412024-12-18T19:44:56.701ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422024-12-18T19:44:56.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62390
8432024-12-18T19:44:56.710ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_8c9f32d3-0bf2-4a33-8eb6-a810d5021be0': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
8442024-12-18T19:44:56.710ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8805 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62390 req_id = 14d22d70-ff7a-4c23-8524-12cf879f8198 response_code = 500 uri = /timesync
8452024-12-18T19:44:56.713ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462024-12-18T19:44:56.966ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472024-12-18T19:44:56.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34785
8482024-12-18T19:44:58.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8492024-12-18T19:44:58.879ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8502024-12-18T19:45:01.091ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8512024-12-18T19:45:01.091ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8522024-12-18T19:45:01.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4008998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34785 req_id = 00e70d3b-6d90-4891-806d-826dc61519a7 response_code = 200 uri = /timesync
8532024-12-18T19:45:01.656ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8542024-12-18T19:45:01.656ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552024-12-18T19:45:02.124ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562024-12-18T19:45:02.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48487
8572024-12-18T19:45:02.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48487 req_id = 9e123998-5d2c-4f3f-9045-b5845b22bff2 response_code = 200 uri = /timesync
8582024-12-18T19:45:02.137ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8592024-12-18T19:45:02.137ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602024-12-18T19:45:02.490ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612024-12-18T19:45:02.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50794
8622024-12-18T19:45:02.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8599 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50794 req_id = 83cf3b62-5df6-44d6-8261-51444e08738b response_code = 200 uri = /timesync
8632024-12-18T19:45:02.502ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8642024-12-18T19:45:02.502ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652024-12-18T19:45:02.922ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662024-12-18T19:45:02.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59612
8672024-12-18T19:45:02.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8559 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59612 req_id = 82a6d91f-f480-4d28-8899-65c0104b9f67 response_code = 200 uri = /timesync
8682024-12-18T19:45:02.932ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8692024-12-18T19:45:02.932ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702024-12-18T19:45:03.036ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8712024-12-18T19:45:03.036ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8722024-12-18T19:45:03.389ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8732024-12-18T19:45:03.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53576
8742024-12-18T19:45:03.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8448 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53576 req_id = caf61707-dc89-4869-9791-d9ac16495776 response_code = 200 uri = /timesync
8752024-12-18T19:45:03.399ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.332983375 } file = sled-agent/src/rack_setup/service.rs:743
8762024-12-18T19:45:03.399ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8772024-12-18T19:45:03.895ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782024-12-18T19:45:03.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32847
8792024-12-18T19:45:03.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32847 req_id = 9cc269ff-f4d0-41c4-8b8a-f75072b8f523 response_code = 200 uri = /timesync
8802024-12-18T19:45:03.906ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.331608146 } file = sled-agent/src/rack_setup/service.rs:743
8812024-12-18T19:45:03.906ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822024-12-18T19:45:04.239ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832024-12-18T19:45:04.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48025
8842024-12-18T19:45:04.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8563 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48025 req_id = 620469e8-f559-4be0-a21e-87089cee7abe response_code = 200 uri = /timesync
8852024-12-18T19:45:04.250ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.341783255 } file = sled-agent/src/rack_setup/service.rs:743
8862024-12-18T19:45:04.250ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872024-12-18T19:45:04.852ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882024-12-18T19:45:04.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46885
8892024-12-18T19:45:04.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8578 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46885 req_id = 2e2d0d2c-2082-4206-a3a6-557684b6812c response_code = 200 uri = /timesync
8902024-12-18T19:45:04.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.340118617 } file = sled-agent/src/rack_setup/service.rs:743
8912024-12-18T19:45:04.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922024-12-18T19:45:05.360ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932024-12-18T19:45:05.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56642
8942024-12-18T19:45:05.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56642 req_id = 4f727f13-4a28-408c-b2dd-90dd2acf5199 response_code = 200 uri = /timesync
8952024-12-18T19:45:05.370ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.335755438 } file = sled-agent/src/rack_setup/service.rs:743
8962024-12-18T19:45:05.370ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972024-12-18T19:45:05.418ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8982024-12-18T19:45:05.422ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
8992024-12-18T19:45:05.490ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9002024-12-18T19:45:06.516ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9012024-12-18T19:45:06.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33218
9022024-12-18T19:45:06.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8707 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33218 req_id = 0a52ffc6-9dbd-47e3-a0ee-1760b6fc3253 response_code = 200 uri = /timesync
9032024-12-18T19:45:06.528ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551105.890175, correction: -0.317268163 } file = sled-agent/src/rack_setup/service.rs:743
9042024-12-18T19:45:06.528ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9052024-12-18T19:45:07.266ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062024-12-18T19:45:07.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57893
9072024-12-18T19:45:07.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57893 req_id = ee1eeaed-f78e-4738-9505-595c5c1d8755 response_code = 200 uri = /timesync
9082024-12-18T19:45:07.279ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1734551099.1852458, correction: -0.315229326 } file = sled-agent/src/rack_setup/service.rs:743
9092024-12-18T19:45:07.279ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102024-12-18T19:45:08.599ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112024-12-18T19:45:08.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41154
9122024-12-18T19:45:08.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41154 req_id = 77217b10-8bcd-492f-8014-ee81850c4f11 response_code = 200 uri = /timesync
9132024-12-18T19:45:08.610ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551107.6323397, correction: -0.309270769 } file = sled-agent/src/rack_setup/service.rs:743
9142024-12-18T19:45:08.610ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152024-12-18T19:45:09.255ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 340.513999ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9162024-12-18T19:45:09.707ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9172024-12-18T19:45:09.707ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9182024-12-18T19:45:10.212ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47855
9192024-12-18T19:45:10.212ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47855 req_id = 2a54d43a-d989-430f-ad60-8232a593ac90 response_code = 200 uri = /baseboard
9202024-12-18T19:45:10.433ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9212024-12-18T19:45:10.433ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33400
9222024-12-18T19:45:10.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33400 req_id = 5f602316-d5ec-4c94-b846-965be305c871 response_code = 200 uri = /timesync
9232024-12-18T19:45:10.445ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551109.5901248, correction: -0.303797036 } file = sled-agent/src/rack_setup/service.rs:743
9242024-12-18T19:45:10.445ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9252024-12-18T19:45:11.123ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9262024-12-18T19:45:11.123ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9272024-12-18T19:45:11.754ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9282024-12-18T19:45:11.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40366
9292024-12-18T19:45:11.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40366 req_id = e1cbde0c-075d-4bd0-af27-9018e79b85c8 response_code = 200 uri = /timesync
9302024-12-18T19:45:11.765ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551110.4047227, correction: -0.299558342 } file = sled-agent/src/rack_setup/service.rs:743
9312024-12-18T19:45:11.765ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9322024-12-18T19:45:13.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9332024-12-18T19:45:13.013ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9342024-12-18T19:45:13.669ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9352024-12-18T19:45:13.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52663
9362024-12-18T19:45:13.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52663 req_id = 00056c81-bdc3-4f1f-9715-76eccc22035e response_code = 200 uri = /timesync
9372024-12-18T19:45:13.680ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551112.8886914, correction: -0.293531299 } file = sled-agent/src/rack_setup/service.rs:743
9382024-12-18T19:45:13.680ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9392024-12-18T19:45:15.392ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9402024-12-18T19:45:15.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9412024-12-18T19:45:15.463ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9422024-12-18T19:45:16.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9432024-12-18T19:45:16.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36744
9442024-12-18T19:45:16.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36744 req_id = 99aa2178-d635-4125-bac1-2a22f227f374 response_code = 200 uri = /timesync
9452024-12-18T19:45:16.828ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551115.9429924, correction: -0.28586933 } file = sled-agent/src/rack_setup/service.rs:743
9462024-12-18T19:45:16.828ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9472024-12-18T19:45:19.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9482024-12-18T19:45:19.681ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9492024-12-18T19:45:21.088ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9502024-12-18T19:45:21.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54098
9512024-12-18T19:45:21.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8635 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54098 req_id = f3acf1ec-0fe6-48ab-921e-b3bf6d6b6237 response_code = 200 uri = /timesync
9522024-12-18T19:45:21.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9532024-12-18T19:45:21.099ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9542024-12-18T19:45:21.100ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551119.4577336, correction: -0.273803025 } file = sled-agent/src/rack_setup/service.rs:743
9552024-12-18T19:45:21.100ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9562024-12-18T19:45:22.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9572024-12-18T19:45:22.987ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9582024-12-18T19:45:24.589ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 516.387749ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9592024-12-18T19:45:25.366ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9602024-12-18T19:45:25.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9612024-12-18T19:45:25.438ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9622024-12-18T19:45:26.105ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9632024-12-18T19:45:26.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39660
9642024-12-18T19:45:26.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8950 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39660 req_id = 6e39f0ec-73dd-4824-9471-d374bd5aa813 response_code = 200 uri = /timesync
9652024-12-18T19:45:26.116ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551124.8024974, correction: -0.260246098 } file = sled-agent/src/rack_setup/service.rs:743
9662024-12-18T19:45:26.116ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9672024-12-18T19:45:29.656ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8222249039349039307 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9682024-12-18T19:45:29.657ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 14005542446473069991 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9692024-12-18T19:45:31.074ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9702024-12-18T19:45:31.074ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9712024-12-18T19:45:31.547ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9722024-12-18T19:45:31.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60456
9732024-12-18T19:45:31.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60456 req_id = 647350b4-6412-4cb0-b06e-808f494e6803 response_code = 200 uri = /timesync
9742024-12-18T19:45:31.559ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551128.8625998, correction: -0.245405078 } file = sled-agent/src/rack_setup/service.rs:743
9752024-12-18T19:45:31.559ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9762024-12-18T19:45:32.962ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9772024-12-18T19:45:32.963ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9782024-12-18T19:45:34.643ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9792024-12-18T19:45:34.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54871
9802024-12-18T19:45:34.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54871 req_id = 9f655864-eda2-4e29-bcbc-7b54dd4cacfd response_code = 200 uri = /timesync
9812024-12-18T19:45:34.656ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551132.79752, correction: -0.237046704 } file = sled-agent/src/rack_setup/service.rs:743
9822024-12-18T19:45:34.656ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9832024-12-18T19:45:35.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9842024-12-18T19:45:35.342ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9852024-12-18T19:45:35.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9862024-12-18T19:45:40.101ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.33758247s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9872024-12-18T19:45:40.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57282
9882024-12-18T19:45:40.166ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57282 req_id = 8c00c6b2-ff37-45a8-814f-198ba28c2b22 response_code = 200 uri = /baseboard
9892024-12-18T19:45:41.048ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9902024-12-18T19:45:41.048ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9912024-12-18T19:45:42.937ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9922024-12-18T19:45:42.937ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9932024-12-18T19:45:44.075ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9942024-12-18T19:45:44.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57122
9952024-12-18T19:45:44.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8916 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57122 req_id = dc6ec73b-916d-4de3-a07b-fd69d36233d6 response_code = 200 uri = /timesync
9962024-12-18T19:45:44.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551142.693365, correction: -0.211083338 } file = sled-agent/src/rack_setup/service.rs:743
9972024-12-18T19:45:44.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9982024-12-18T19:45:45.318ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 846760883544400993 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
9992024-12-18T19:45:45.318ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 723288327032574808 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10002024-12-18T19:45:45.385ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17577909250087867874 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10012024-12-18T19:45:51.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10022024-12-18T19:45:51.023ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10032024-12-18T19:45:52.912ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18233914195269271637 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10042024-12-18T19:45:52.913ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15186691459583320840 reason = Duration(60s) sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10052024-12-18T19:45:55.852ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10062024-12-18T19:45:55.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52641
10072024-12-18T19:45:55.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9022 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52641 req_id = ed0e0d07-f94c-4211-b5f9-ef2491369fd5 response_code = 200 uri = /timesync
10082024-12-18T19:45:55.864ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551155.3351572, correction: -0.179339245 } file = sled-agent/src/rack_setup/service.rs:743
10092024-12-18T19:45:55.864ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10102024-12-18T19:45:56.428ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.976371852s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10112024-12-18T19:46:00.998ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10122024-12-18T19:46:00.998ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10132024-12-18T19:46:03.966ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10142024-12-18T19:46:03.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49935
10152024-12-18T19:46:03.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49935 req_id = d3a4025a-5ab4-4eb1-8b0e-14ec9bd1d3c5 response_code = 200 uri = /timesync
10162024-12-18T19:46:03.977ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551163.3470008, correction: -0.157409176 } file = sled-agent/src/rack_setup/service.rs:743
10172024-12-18T19:46:03.977ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10182024-12-18T19:46:09.822ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10192024-12-18T19:46:09.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51231
10202024-12-18T19:46:09.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51231 req_id = b87a6747-03d1-44e5-8146-d3ff14eb5927 response_code = 200 uri = /timesync
10212024-12-18T19:46:09.834ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551163.3470008, correction: -0.141505361 } file = sled-agent/src/rack_setup/service.rs:743
10222024-12-18T19:46:09.834ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10232024-12-18T19:46:10.119ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36202
10242024-12-18T19:46:10.119ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36202 req_id = 35f2bd60-71b1-4c01-afeb-7930fe3a438a response_code = 200 uri = /baseboard
10252024-12-18T19:46:10.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10262024-12-18T19:46:10.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10272024-12-18T19:46:13.393ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.723487774s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10282024-12-18T19:46:20.948ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10292024-12-18T19:46:20.948ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10302024-12-18T19:46:27.281ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10312024-12-18T19:46:27.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47312
10322024-12-18T19:46:27.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47312 req_id = 11e8fe6b-e92a-45bb-96f0-f92c65025a78 response_code = 200 uri = /timesync
10332024-12-18T19:46:27.293ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551179.0659802, correction: -0.094262257 } file = sled-agent/src/rack_setup/service.rs:743
10342024-12-18T19:46:27.293ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10352024-12-18T19:46:30.923ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10362024-12-18T19:46:30.923ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10372024-12-18T19:46:32.101ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.272217973s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10382024-12-18T19:46:37.195ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10392024-12-18T19:46:37.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48900
10402024-12-18T19:46:37.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8955 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48900 req_id = 82ceced0-5671-474d-9c7a-6a8880829b84 response_code = 200 uri = /timesync
10412024-12-18T19:46:37.207ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551195.516416, correction: -0.067554288 } file = sled-agent/src/rack_setup/service.rs:743
10422024-12-18T19:46:37.207ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10432024-12-18T19:46:40.071ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36701
10442024-12-18T19:46:40.071ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36701 req_id = e31a0ce1-b1bb-47c8-a9a9-925b6b15e1c5 response_code = 200 uri = /baseboard
10452024-12-18T19:46:40.899ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13179169043542680095 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10462024-12-18T19:46:40.899ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4391099972307942253 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10472024-12-18T19:46:49.181ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10482024-12-18T19:46:49.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34681
10492024-12-18T19:46:49.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21665 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34681 req_id = 9fccfb44-3e12-432b-89b4-97fd2405ee7d response_code = 200 uri = /timesync
10502024-12-18T19:46:49.204ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:29.656782043Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8222249039349039307 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10512024-12-18T19:46:49.205ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:52.912817637Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18233914195269271637 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10522024-12-18T19:46:49.205ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:52.913091002Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15186691459583320840 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10532024-12-18T19:46:49.205ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:45.385917975Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17577909250087867874 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10542024-12-18T19:46:49.206ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:45.318189428Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 846760883544400993 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10552024-12-18T19:46:49.206ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:29.657479878Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 14005542446473069991 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10562024-12-18T19:46:49.206ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2024-12-18T19:45:45.318699979Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 723288327032574808 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10572024-12-18T19:46:49.208ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2501655913, ip_addr: 149.28.61.105, stratum: 4, ref_time: 1734551203.6669714, correction: -0.035036344 } file = sled-agent/src/rack_setup/service.rs:743
10582024-12-18T19:46:49.208ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10592024-12-18T19:46:49.239ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 73c17a86-f1fb-4102-92b8-0059f9ce4d77 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89d5399b-5669-48fc-9549-d301f3010160 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 967a5ab6-9437-47ac-b51c-7113605783e5 (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 (service), filesystem_pool: Some(ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cff37dfe-fdfd-4aa8-b0a0-761c65f1ab7f, kind: Service { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 }, name: Name("ntp-8c9f32d3-0bf2-4a33-8eb6-a810d5021be0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 176])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 24fa563b-5671-4198-9669-4ed292e50b31 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 2bac3bf1-8b82-479a-9c38-33c093b00b1a (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 23d1c38b-56c9-47e1-90e9-913b3df1846a (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } } } }, OmicronZoneConfig { id: 30ed9ab7-5fec-442a-8041-7f61a7429ca3 (service), filesystem_pool: Some(ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External } } } }, OmicronZoneConfig { id: e17bb31b-4db9-42d1-949e-d779e5bf2a04 (service), filesystem_pool: Some(ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10602024-12-18T19:46:49.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60552
10612024-12-18T19:46:49.240ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10622024-12-18T19:46:49.240ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10632024-12-18T19:46:49.252ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10642024-12-18T19:46:49.252ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10652024-12-18T19:46:49.262ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10662024-12-18T19:46:49.262ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10672024-12-18T19:46:49.271ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10682024-12-18T19:46:49.271ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10692024-12-18T19:46:49.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10702024-12-18T19:46:49.281ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10712024-12-18T19:46:49.290ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10722024-12-18T19:46:49.290ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10732024-12-18T19:46:49.299ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10742024-12-18T19:46:49.299ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10752024-12-18T19:46:49.308ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10762024-12-18T19:46:49.308ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10772024-12-18T19:46:49.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782024-12-18T19:46:49.317ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
10792024-12-18T19:46:49.317ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
10802024-12-18T19:46:49.317ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812024-12-18T19:46:49.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10822024-12-18T19:46:49.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10832024-12-18T19:46:49.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10842024-12-18T19:46:49.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852024-12-18T19:46:49.399ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862024-12-18T19:46:49.493ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a file = illumos-utils/src/zone.rs:325
10872024-12-18T19:46:49.497ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31 file = illumos-utils/src/zone.rs:325
10882024-12-18T19:46:49.501ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04 file = illumos-utils/src/zone.rs:325
10892024-12-18T19:46:49.506ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a file = illumos-utils/src/zone.rs:325
10902024-12-18T19:46:49.510ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3 file = illumos-utils/src/zone.rs:325
10912024-12-18T19:46:49.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a file = illumos-utils/src/zone.rs:363
10922024-12-18T19:46:49.520ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31 file = illumos-utils/src/zone.rs:363
10932024-12-18T19:46:49.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04 file = illumos-utils/src/zone.rs:363
10942024-12-18T19:46:49.529ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a file = illumos-utils/src/zone.rs:363
10952024-12-18T19:46:49.534ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3 file = illumos-utils/src/zone.rs:363
10962024-12-18T19:46:52.356ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 16.331783175s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
10972024-12-18T19:46:53.315ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='24fa563b-5671-4198-9669-4ed292e50b31'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10982024-12-18T19:46:53.315ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
10992024-12-18T19:46:53.321ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='30ed9ab7-5fec-442a-8041-7f61a7429ca3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11002024-12-18T19:46:53.321ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11012024-12-18T19:46:53.352ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='23d1c38b-56c9-47e1-90e9-913b3df1846a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11022024-12-18T19:46:53.352ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11032024-12-18T19:46:53.370ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e17bb31b-4db9-42d1-949e-d779e5bf2a04'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11042024-12-18T19:46:53.370ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11052024-12-18T19:46:53.425ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2bac3bf1-8b82-479a-9c38-33c093b00b1a'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11062024-12-18T19:46:53.425ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11072024-12-18T19:46:53.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 62.545292ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11082024-12-18T19:46:53.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 51.892657ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11092024-12-18T19:46:53.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 45.167399ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11102024-12-18T19:46:53.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 74.979099ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11112024-12-18T19:46:53.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 145.544063ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11122024-12-18T19:46:53.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 58.538314ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11132024-12-18T19:46:53.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 81.167953ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11142024-12-18T19:46:53.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 124.377563ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11152024-12-18T19:46:53.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 70.835845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11162024-12-18T19:46:53.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 286.29453ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11172024-12-18T19:46:53.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 208.858439ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11182024-12-18T19:46:54.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 70.516948ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11192024-12-18T19:46:54.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 240.662279ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11202024-12-18T19:46:54.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 403.158741ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11212024-12-18T19:46:54.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 146.125635ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11222024-12-18T19:46:54.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 367.400943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11232024-12-18T19:46:54.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 202.449823ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11242024-12-18T19:46:54.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 463.606332ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11252024-12-18T19:46:54.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 598.221941ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11262024-12-18T19:46:54.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 404.917557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11272024-12-18T19:46:54.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 898.584561ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11282024-12-18T19:46:54.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.024445754s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11292024-12-18T19:46:54.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 939.180876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11302024-12-18T19:46:54.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 579.608052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11312024-12-18T19:46:55.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 778.238429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11322024-12-18T19:46:55.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 1.217412855s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11332024-12-18T19:46:55.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 1.453459111s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11342024-12-18T19:46:55.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.269697576s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11352024-12-18T19:46:55.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 541.517047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11362024-12-18T19:46:55.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.189423263s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11372024-12-18T19:46:56.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 838.465665ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11382024-12-18T19:46:56.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 994.991488ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11392024-12-18T19:46:56.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 535.662963ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11402024-12-18T19:46:57.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 1.126753531s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11412024-12-18T19:46:57.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.051427923s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11422024-12-18T19:46:57.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 781.949328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11432024-12-18T19:46:57.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 706.978217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11442024-12-18T19:46:57.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 783.200121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11452024-12-18T19:46:58.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 1.201291957s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11462024-12-18T19:46:58.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.456788372s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11472024-12-18T19:46:58.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 941.885129ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11482024-12-18T19:46:58.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.155807926s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11492024-12-18T19:46:58.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 822.410897ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11502024-12-18T19:46:59.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 968.871076ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11512024-12-18T19:46:59.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 956.01183ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11522024-12-18T19:46:59.368ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 587.657902ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11532024-12-18T19:46:59.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 578.592425ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11542024-12-18T19:46:59.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.072200925s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11552024-12-18T19:46:59.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 1.072280728s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11562024-12-18T19:46:59.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 751.561624ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11572024-12-18T19:47:00.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 1.361899866s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11582024-12-18T19:47:00.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 1.484577605s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11592024-12-18T19:47:00.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.479644153s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11602024-12-18T19:47:00.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.489230935s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11612024-12-18T19:47:01.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 534.609803ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11622024-12-18T19:47:01.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 680.724271ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11632024-12-18T19:47:01.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 1.141477412s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11642024-12-18T19:47:01.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 971.160239ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11652024-12-18T19:47:02.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 1.140776038s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11662024-12-18T19:47:02.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.142428134s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11672024-12-18T19:47:02.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 595.355401ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11682024-12-18T19:47:02.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 1.080912962s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11692024-12-18T19:47:02.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 891.589485ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11702024-12-18T19:47:02.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 995.096819ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11712024-12-18T19:47:03.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 958.368721ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11722024-12-18T19:47:03.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.237681123s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11732024-12-18T19:47:03.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 683.602823ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11742024-12-18T19:47:03.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 1.281395522s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11752024-12-18T19:47:03.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.271128651s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11762024-12-18T19:47:04.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 1.237137032s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11772024-12-18T19:47:04.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 958.988852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11782024-12-18T19:47:04.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 701.843465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11792024-12-18T19:47:05.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 948.462759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11802024-12-18T19:47:05.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 1.237167046s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11812024-12-18T19:47:05.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 963.709026ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11822024-12-18T19:47:05.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 937.652089ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11832024-12-18T19:47:05.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 551.896284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11842024-12-18T19:47:06.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 631.696047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11852024-12-18T19:47:06.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 848.248906ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11862024-12-18T19:47:06.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 683.854163ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11872024-12-18T19:47:06.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 801.950878ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11882024-12-18T19:47:06.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 849.067487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11892024-12-18T19:47:06.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a") failed: Property not found. retry in 1.355078709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
11902024-12-18T19:47:06.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 895.139017ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11912024-12-18T19:47:06.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 794.381594ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11922024-12-18T19:47:07.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.019541394s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11932024-12-18T19:47:07.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31") failed: Property not found. retry in 975.313051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11942024-12-18T19:47:07.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a") failed: Property not found. retry in 788.765157ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11952024-12-18T19:47:07.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3") failed: Property not found. retry in 923.195459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
11962024-12-18T19:47:08.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04") failed: Property not found. retry in 1.132425007s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
11972024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_2bac3bf1-8b82-479a-9c38-33c093b00b1a
11982024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_24fa563b-5671-4198-9669-4ed292e50b31
11992024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e17bb31b-4db9-42d1-949e-d779e5bf2a04
12002024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a
12012024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_30ed9ab7-5fec-442a-8041-7f61a7429ca3
12022024-12-18T19:47:09.264ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12032024-12-18T19:47:09.265ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
12042024-12-18T19:47:09.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20060930 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60552 req_id = 9382789e-ca2e-4d39-bdb7-715c911bf1ff response_code = 204 uri = /omicron-zones
12052024-12-18T19:47:09.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39531
12062024-12-18T19:47:09.330ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29650 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39531 req_id = 1a80cd7d-812d-4385-bd09-380879ee32e4 response_code = 500 uri = /cockroachdb
12072024-12-18T19:47:09.330ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1a80cd7d-812d-4385-bd09-380879ee32e4", "content-length": "124", "date": "Wed, 18 Dec 2024 19:47:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1a80cd7d-812d-4385-bd09-380879ee32e4" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 64.552804ms
12082024-12-18T19:47:09.426ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39531 req_id = 0271a8f1-ce02-4260-9dfd-7d7c6f015348 response_code = 500 uri = /cockroachdb
12092024-12-18T19:47:09.426ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0271a8f1-ce02-4260-9dfd-7d7c6f015348", "content-length": "124", "date": "Wed, 18 Dec 2024 19:47:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0271a8f1-ce02-4260-9dfd-7d7c6f015348" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 164.092936ms
12102024-12-18T19:47:09.620ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
12112024-12-18T19:47:25.830ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
12122024-12-18T19:47:36.498ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize CockroachDb: Error running command in zone 'oxz_cockroachdb_23d1c38b-56c9-47e1-90e9-913b3df1846a': Command [/opt/oxide/cockroachdb/bin/cockroach sql --insecure --host [fd00:1122:3344:101::5]:32221 --file /opt/oxide/cockroachdb/sql/dbinit.sql] executed and failed with status: exit status: 1 stdout: BEGIN\nCREATE DATABASE\nCREATE ROLE\nALTER DEFAULT PRIVILEGES\nCONFIGURE ZONE 1\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE VIEW\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE VIEW\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nINSERT 1\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCREATE TABLE\nCOMMIT\nBEGIN\nCREATE TABLE\nCREATE INDEX\nCREATE VIEW\nCREATE SEQUENCE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE VIEW\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TYPE\nCREATE TABLE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE VIEW\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE TABLE\nCREATE TABLE\nINSERT 1\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nCREATE TYPE\nCREATE TABLE\nCREATE INDEX\nCREATE INDEX\nCREATE INDEX\nINSERT 1\n stderr: ERROR: transaction committed but schema change aborted with error: (53200): failed to ingest index entries during backfill: not enough memory available to create a BulkAdder: root: memory budget exceeded: 33554432 bytes requested, 102035456 currently allocated, 134217728 bytes in budget\nSQLSTATE: XXA00\nHINT: Consider increasing --max-sql-memory startup parameter.\n--\nTry setting a higher --max-sql-memory.\n--\nSome of the non-DDL statements may have committed successfully, but some of the DDL statement(s) failed.\nManual inspection may be required to determine the actual state of the database.\n--\nSee: https://github.com/cockroachdb/cockroach/issues/42061\nERROR: transaction committed but schema change aborted with error: (53200): failed to ingest index entries during backfill: not enough memory available to create a BulkAdder: root: memory budget exceeded: 33554432 bytes requested, 102035456 currently allocated, 134217728 bytes in budget\nSQLSTATE: XXA00\nHINT: Consider increasing --max-sql-memory startup parameter.\n--\nTry setting a higher --max-sql-memory.\n--\nSome of the non-DDL statements may have committed successfully, but some of the DDL statement(s) failed.\nManual inspection may be required to determine the actual state of the database.\n--\nSee: https://github.com/cockroachdb/cockroach/issues/42061\nFailed running "sql"\n file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26907351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39531 req_id = 8492703f-5213-4f11-b824-c8c1e6dcc007 response_code = 500 uri = /cockroachdb
12132024-12-18T19:47:36.502ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39764
12142024-12-18T19:47:36.503ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8492703f-5213-4f11-b824-c8c1e6dcc007", "content-length": "124", "date": "Wed, 18 Dec 2024 19:47:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8492703f-5213-4f11-b824-c8c1e6dcc007" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 180.985098ms
12152024-12-18T19:47:36.514ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 45.093093889s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
12162024-12-18T19:47:36.726ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3743
12172024-12-18T19:47:36.845ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
12182024-12-18T19:47:43.140ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
12192024-12-18T19:47:43.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6455107 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:39531 req_id = cb4f50fa-ba62-427b-8ca3-f00b97fc491e response_code = 204 uri = /cockroachdb
12202024-12-18T19:47:43.183ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 73c17a86-f1fb-4102-92b8-0059f9ce4d77 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 89d5399b-5669-48fc-9549-d301f3010160 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 967a5ab6-9437-47ac-b51c-7113605783e5 (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 (service), filesystem_pool: Some(ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: cff37dfe-fdfd-4aa8-b0a0-761c65f1ab7f, kind: Service { id: 8c9f32d3-0bf2-4a33-8eb6-a810d5021be0 }, name: Name("ntp-8c9f32d3-0bf2-4a33-8eb6-a810d5021be0"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 166, 176])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 24fa563b-5671-4198-9669-4ed292e50b31 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 2bac3bf1-8b82-479a-9c38-33c093b00b1a (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 23d1c38b-56c9-47e1-90e9-913b3df1846a (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } } } }, OmicronZoneConfig { id: 30ed9ab7-5fec-442a-8041-7f61a7429ca3 (service), filesystem_pool: Some(ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External } } } }, OmicronZoneConfig { id: e17bb31b-4db9-42d1-949e-d779e5bf2a04 (service), filesystem_pool: Some(ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: e8590144-bfff-4d2e-aa70-065d47db3a0f (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 1139ebda-6055-49a8-8243-f0019044de70 (service), filesystem_pool: Some(ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b (service), filesystem_pool: Some(ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2a7637c0-f465-4032-a837-76ff2b185388 (service), filesystem_pool: Some(ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 3204ca74-ea13-4042-a075-6a8d1de2ee02 (service), filesystem_pool: Some(ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 35cf0d92-c4e4-4a09-8523-a18ec4d945a8 (service), filesystem_pool: Some(ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 64813786-f895-4d99-97f3-a8f85331321d (service), filesystem_pool: Some(ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 8d7103cd-7f05-41c9-b8dd-116e6f988ade (service), filesystem_pool: Some(ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External } } } }, OmicronZoneConfig { id: e62e166d-3195-4993-9658-25854943a145 (service), filesystem_pool: Some(ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5089823b-255d-4f80-8f09-55f4e892bd09 (service), filesystem_pool: Some(ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External } } } }, OmicronZoneConfig { id: 561cdd3b-973b-469c-9ddc-cc0204a9e8e2 (service), filesystem_pool: Some(ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External } } } }, OmicronZoneConfig { id: 91754436-1534-4d5c-942f-012e90fd9ab0 (service), filesystem_pool: Some(ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External } } } }, OmicronZoneConfig { id: c17822b5-dd64-4e7f-adf2-30dae16c4344 (service), filesystem_pool: Some(ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External } } } }, OmicronZoneConfig { id: acf239d0-d637-4ea6-98b7-7e82b5951798 (service), filesystem_pool: Some(ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 882b5f00-9810-42db-845d-5c19147b5f47 (service), filesystem_pool: Some(ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External } } } }, OmicronZoneConfig { id: 2d5b2421-8a1b-401d-bfda-767ed2a1f446 (service), filesystem_pool: Some(ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12212024-12-18T19:47:43.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43674
12222024-12-18T19:47:43.184ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12232024-12-18T19:47:43.184ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
12242024-12-18T19:47:43.200ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12252024-12-18T19:47:43.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12262024-12-18T19:47:43.212ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12272024-12-18T19:47:43.212ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12282024-12-18T19:47:43.222ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12292024-12-18T19:47:43.222ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
12302024-12-18T19:47:43.232ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12312024-12-18T19:47:43.232ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12322024-12-18T19:47:43.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12332024-12-18T19:47:43.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12342024-12-18T19:47:43.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12352024-12-18T19:47:43.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12362024-12-18T19:47:43.263ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12372024-12-18T19:47:43.263ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12382024-12-18T19:47:43.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12392024-12-18T19:47:43.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12402024-12-18T19:47:43.283ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12412024-12-18T19:47:43.283ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12422024-12-18T19:47:43.294ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12432024-12-18T19:47:43.294ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12442024-12-18T19:47:43.304ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12452024-12-18T19:47:43.304ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, kind: Crucible }, responder: ... }
12462024-12-18T19:47:43.314ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12472024-12-18T19:47:43.314ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, kind: Crucible }, responder: ... }
12482024-12-18T19:47:43.324ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12492024-12-18T19:47:43.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, kind: Crucible }, responder: ... }
12502024-12-18T19:47:43.334ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12512024-12-18T19:47:43.334ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, kind: Crucible }, responder: ... }
12522024-12-18T19:47:43.345ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12532024-12-18T19:47:43.345ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, kind: Crucible }, responder: ... }
12542024-12-18T19:47:43.355ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12552024-12-18T19:47:43.355ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, kind: Crucible }, responder: ... }
12562024-12-18T19:47:43.366ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12572024-12-18T19:47:43.366ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, kind: Crucible }, responder: ... }
12582024-12-18T19:47:43.376ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12592024-12-18T19:47:43.376ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, kind: Crucible }, responder: ... }
12602024-12-18T19:47:43.385ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12612024-12-18T19:47:43.385ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, kind: Crucible }, responder: ... }
12622024-12-18T19:47:43.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12632024-12-18T19:47:43.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
12642024-12-18T19:47:43.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
12652024-12-18T19:47:43.398ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12662024-12-18T19:47:43.533ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12672024-12-18T19:47:43.533ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12682024-12-18T19:47:43.560ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12692024-12-18T19:47:43.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12702024-12-18T19:47:43.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12712024-12-18T19:47:43.562ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12722024-12-18T19:47:43.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12732024-12-18T19:47:43.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12742024-12-18T19:47:43.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12752024-12-18T19:47:43.603ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12762024-12-18T19:47:43.763ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12772024-12-18T19:47:43.763ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12782024-12-18T19:47:43.763ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12792024-12-18T19:47:43.763ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12802024-12-18T19:47:43.825ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12812024-12-18T19:47:43.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12822024-12-18T19:47:43.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12832024-12-18T19:47:43.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12842024-12-18T19:47:43.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12852024-12-18T19:47:43.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e62e166d-3195-4993-9658-25854943a145 file = illumos-utils/src/zone.rs:325
12862024-12-18T19:47:43.831ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2 file = illumos-utils/src/zone.rs:325
12872024-12-18T19:47:43.836ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344 file = illumos-utils/src/zone.rs:325
12882024-12-18T19:47:43.841ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade file = illumos-utils/src/zone.rs:325
12892024-12-18T19:47:43.846ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0 file = illumos-utils/src/zone.rs:325
12902024-12-18T19:47:43.851ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47 file = illumos-utils/src/zone.rs:325
12912024-12-18T19:47:43.856ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388 file = illumos-utils/src/zone.rs:325
12922024-12-18T19:47:44.004ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e62e166d-3195-4993-9658-25854943a145 file = illumos-utils/src/zone.rs:363
12932024-12-18T19:47:44.010ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2 file = illumos-utils/src/zone.rs:363
12942024-12-18T19:47:44.015ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344 file = illumos-utils/src/zone.rs:363
12952024-12-18T19:47:44.021ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade file = illumos-utils/src/zone.rs:363
12962024-12-18T19:47:44.025ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0 file = illumos-utils/src/zone.rs:363
12972024-12-18T19:47:44.030ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47 file = illumos-utils/src/zone.rs:363
12982024-12-18T19:47:44.035ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388 file = illumos-utils/src/zone.rs:363
12992024-12-18T19:47:44.041ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8 file = illumos-utils/src/zone.rs:325
13002024-12-18T19:47:44.045ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d file = illumos-utils/src/zone.rs:325
13012024-12-18T19:47:44.051ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02 file = illumos-utils/src/zone.rs:325
13022024-12-18T19:47:44.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09 file = illumos-utils/src/zone.rs:325
13032024-12-18T19:47:44.063ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446 file = illumos-utils/src/zone.rs:325
13042024-12-18T19:47:44.069ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe file = illumos-utils/src/zone.rs:325
13052024-12-18T19:47:44.076ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798 file = illumos-utils/src/zone.rs:325
13062024-12-18T19:47:44.147ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13072024-12-18T19:47:44.149ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8 file = illumos-utils/src/zone.rs:363
13082024-12-18T19:47:44.176ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d file = illumos-utils/src/zone.rs:363
13092024-12-18T19:47:44.194ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02 file = illumos-utils/src/zone.rs:363
13102024-12-18T19:47:44.204ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09 file = illumos-utils/src/zone.rs:363
13112024-12-18T19:47:44.213ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446 file = illumos-utils/src/zone.rs:363
13122024-12-18T19:47:44.222ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe file = illumos-utils/src/zone.rs:363
13132024-12-18T19:47:44.230ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798 file = illumos-utils/src/zone.rs:363
13142024-12-18T19:47:44.296ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13152024-12-18T19:47:44.353ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13162024-12-18T19:47:44.410ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13172024-12-18T19:47:44.475ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13182024-12-18T19:47:44.479ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13192024-12-18T19:47:44.479ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13202024-12-18T19:47:44.550ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 231, 61]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13212024-12-18T19:47:44.550ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
13222024-12-18T19:47:44.558ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13232024-12-18T19:47:44.558ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13242024-12-18T19:47:44.616ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 172, 115]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13252024-12-18T19:47:44.616ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
13262024-12-18T19:47:44.618ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13272024-12-18T19:47:44.618ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13282024-12-18T19:47:44.675ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 232, 62]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13292024-12-18T19:47:44.675ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
13302024-12-18T19:47:44.676ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13312024-12-18T19:47:44.676ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13322024-12-18T19:47:44.740ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 207, 170]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13332024-12-18T19:47:44.740ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
13342024-12-18T19:47:44.743ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13352024-12-18T19:47:44.743ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13362024-12-18T19:47:44.802ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 131, 162]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13372024-12-18T19:47:44.802ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
13382024-12-18T19:47:44.802ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13392024-12-18T19:47:44.802ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13402024-12-18T19:47:44.803ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13412024-12-18T19:47:44.804ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13422024-12-18T19:47:44.804ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13432024-12-18T19:47:44.804ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13442024-12-18T19:47:44.804ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13452024-12-18T19:47:44.804ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13462024-12-18T19:47:44.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13472024-12-18T19:47:44.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13482024-12-18T19:47:44.817ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13492024-12-18T19:47:44.819ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13502024-12-18T19:47:44.823ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13512024-12-18T19:47:44.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13522024-12-18T19:47:44.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13532024-12-18T19:47:44.825ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13542024-12-18T19:47:44.826ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13552024-12-18T19:47:44.829ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13562024-12-18T19:47:44.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13572024-12-18T19:47:45.042ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13582024-12-18T19:47:45.595ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b file = illumos-utils/src/zone.rs:325
13592024-12-18T19:47:45.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f file = illumos-utils/src/zone.rs:325
13602024-12-18T19:47:45.724ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06 file = illumos-utils/src/zone.rs:325
13612024-12-18T19:47:45.733ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667 file = illumos-utils/src/zone.rs:325
13622024-12-18T19:47:45.744ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70 file = illumos-utils/src/zone.rs:325
13632024-12-18T19:47:45.799ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b file = illumos-utils/src/zone.rs:363
13642024-12-18T19:47:45.846ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f file = illumos-utils/src/zone.rs:363
13652024-12-18T19:47:46.392ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06 file = illumos-utils/src/zone.rs:363
13662024-12-18T19:47:46.447ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667 file = illumos-utils/src/zone.rs:363
13672024-12-18T19:47:46.467ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70 file = illumos-utils/src/zone.rs:363
13682024-12-18T19:47:51.134ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13692024-12-18T19:47:51.136ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13702024-12-18T19:47:51.136ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
13712024-12-18T19:47:51.148ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
13722024-12-18T19:47:51.157ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13732024-12-18T19:47:51.158ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
13742024-12-18T19:47:51.347ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2f0243e8-b4ff-46a0-a894-acc60d2144ae'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13752024-12-18T19:47:51.347ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
13762024-12-18T19:47:51.351ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='26ce4998-aac0-4d2d-a18e-6821e11e3762'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13772024-12-18T19:47:51.361ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e62e166d-3195-4993-9658-25854943a145: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4585f13b-0248-4d0e-a56e-45d95198a363/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aed2d4ff-d516-4918-9d63-e9c923150ade'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782024-12-18T19:47:51.369ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_415023e8-4b60-4f50-85ce-5d337214083f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9e5999bc-7cf6-412a-ae24-bec8fc8d5580'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13792024-12-18T19:47:51.372ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c3612c32-5622-4a67-9ae3-29c036aec45e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c0e81d1c-5029-4b12-9155-3480ef3170ee'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13802024-12-18T19:47:51.379ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3cac1276-c5c6-4399-bb45-675a87b3ac1d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13812024-12-18T19:47:51.396ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3943ba64-84f5-40ee-94de-ef33bd94d891/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5630670-810c-4379-8e12-4bdda176796b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13822024-12-18T19:47:51.401ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3edfafab-aa00-40b0-9bf9-8915f80ffb6f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13832024-12-18T19:47:51.440ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_96909843-abb5-4785-acdb-8d286f18ea02/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e1fb7e89-be9f-40f7-b5bf-36a747880c76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13842024-12-18T19:47:51.440ZINFOSledAgent (ServiceManager): Booting oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
13852024-12-18T19:47:51.445ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e62e166d-3195-4993-9658-25854943a145 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
13862024-12-18T19:47:51.457ZINFOSledAgent (ServiceManager): Booting oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
13872024-12-18T19:47:51.471ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
13882024-12-18T19:47:51.492ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
13892024-12-18T19:47:51.508ZINFOSledAgent (ServiceManager): Booting oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
13902024-12-18T19:47:51.522ZINFOSledAgent (ServiceManager): Booting oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
13912024-12-18T19:47:51.533ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
13922024-12-18T19:47:51.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 38.752332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
13932024-12-18T19:47:51.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 44.064087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
13942024-12-18T19:47:51.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 50.700006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
13952024-12-18T19:47:51.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 48.882318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
13962024-12-18T19:47:51.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 74.81569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
13972024-12-18T19:47:56.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 31.817094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
13982024-12-18T19:47:56.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 41.620586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
13992024-12-18T19:47:56.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 39.026637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14002024-12-18T19:47:56.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 58.289487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14012024-12-18T19:47:56.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 27.044346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14022024-12-18T19:47:56.828ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='2a7637c0-f465-4032-a837-76ff2b185388'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14032024-12-18T19:47:56.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 96.646547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14042024-12-18T19:47:56.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 69.109073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
14052024-12-18T19:47:56.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 114.864515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
14062024-12-18T19:47:56.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 63.592126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14072024-12-18T19:47:56.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 71.775325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14082024-12-18T19:47:56.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 27.399865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14092024-12-18T19:47:56.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 70.232314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14102024-12-18T19:47:57.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 118.66051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14112024-12-18T19:47:57.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 80.614365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
14122024-12-18T19:47:57.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 94.125556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14132024-12-18T19:47:57.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 104.051245ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14142024-12-18T19:47:57.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 141.597314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14152024-12-18T19:47:57.063ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14162024-12-18T19:47:57.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 200.101747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14172024-12-18T19:47:57.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 116.513684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
14182024-12-18T19:47:57.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 218.170702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
14192024-12-18T19:47:57.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 127.272124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14202024-12-18T19:47:57.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 50.273968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14212024-12-18T19:47:57.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 142.238503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14222024-12-18T19:47:57.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 265.38197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14232024-12-18T19:47:57.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 256.616792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14242024-12-18T19:47:57.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 133.563018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
14252024-12-18T19:47:57.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 112.197722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14262024-12-18T19:47:57.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 155.253888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14272024-12-18T19:47:57.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 116.866872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14282024-12-18T19:47:57.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 205.696797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14292024-12-18T19:47:57.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 592.052692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
14302024-12-18T19:47:57.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 207.893647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14312024-12-18T19:47:57.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 205.570866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14322024-12-18T19:47:57.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 264.00247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14332024-12-18T19:47:57.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 575.910747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
14342024-12-18T19:47:57.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 352.358451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14352024-12-18T19:47:57.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 41.12213ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14362024-12-18T19:47:57.354ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14372024-12-18T19:47:57.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 413.137073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
14382024-12-18T19:47:57.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 371.523563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14392024-12-18T19:47:57.380ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14402024-12-18T19:47:57.380ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14412024-12-18T19:47:57.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 321.723934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14422024-12-18T19:47:57.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 50.076002ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14432024-12-18T19:47:57.411ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14442024-12-18T19:47:57.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 233.187456ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14452024-12-18T19:47:57.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 363.960492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14462024-12-18T19:47:57.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 233.615876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14472024-12-18T19:47:57.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 153.243464ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14482024-12-18T19:47:57.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 870.35606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14492024-12-18T19:47:57.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 490.410274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14502024-12-18T19:47:57.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 550.03301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14512024-12-18T19:47:57.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 328.137624ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14522024-12-18T19:47:57.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 63.552484ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14532024-12-18T19:47:57.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 626.580581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14542024-12-18T19:47:57.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 42.08916ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14552024-12-18T19:47:57.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 942.037413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14562024-12-18T19:47:57.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 977.744056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14572024-12-18T19:47:57.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 95.960286ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14582024-12-18T19:47:57.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 799.181857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14592024-12-18T19:47:57.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 446.691847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14602024-12-18T19:47:57.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 147.691122ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14612024-12-18T19:47:57.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.151250549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
14622024-12-18T19:47:57.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 503.588691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14632024-12-18T19:47:57.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 284.91936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14642024-12-18T19:47:57.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 760.874067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
14652024-12-18T19:47:57.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.070173164s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
14662024-12-18T19:47:57.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 154.557188ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14672024-12-18T19:47:57.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 553.884937ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14682024-12-18T19:47:58.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.077334265s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14692024-12-18T19:47:58.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 205.974142ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14702024-12-18T19:47:58.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 433.194498ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14712024-12-18T19:47:58.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 601.786223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14722024-12-18T19:47:58.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.47211549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
14732024-12-18T19:47:58.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 587.905518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14742024-12-18T19:47:58.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 882.902355ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14752024-12-18T19:47:58.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 958.262215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14762024-12-18T19:47:58.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.12623421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14772024-12-18T19:47:58.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 634.053622ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14782024-12-18T19:47:58.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.170178088s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
14792024-12-18T19:47:58.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 432.684013ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14802024-12-18T19:47:58.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.182985441s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
14812024-12-18T19:47:58.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.469158502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
14822024-12-18T19:47:58.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.352479306s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
14832024-12-18T19:47:58.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.169784796s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
14842024-12-18T19:47:59.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.225618967s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
14852024-12-18T19:47:59.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.057835886s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
14862024-12-18T19:47:59.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.269693454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
14872024-12-18T19:47:59.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.041297224s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
14882024-12-18T19:47:59.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.031874919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
14892024-12-18T19:47:59.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 582.892051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
14902024-12-18T19:47:59.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.222851696s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
14912024-12-18T19:47:59.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.477065762s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
14922024-12-18T19:47:59.389ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14932024-12-18T19:47:59.389ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14942024-12-18T19:47:59.390ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14952024-12-18T19:47:59.390ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
14962024-12-18T19:47:59.397ZINFOSledAgent (ServiceManager): Booting oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
14972024-12-18T19:47:59.405ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
14982024-12-18T19:47:59.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 603.499293ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
14992024-12-18T19:47:59.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 63.540001ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15002024-12-18T19:47:59.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 60.497724ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15012024-12-18T19:47:59.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.454745522s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
15022024-12-18T19:47:59.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 888.370419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
15032024-12-18T19:48:00.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.374138892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
15042024-12-18T19:48:00.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 47.76005ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15052024-12-18T19:48:00.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 738.664188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15062024-12-18T19:48:00.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.343176304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
15072024-12-18T19:48:00.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 141.77313ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15082024-12-18T19:48:00.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 109.980596ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15092024-12-18T19:48:00.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.143595979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
15102024-12-18T19:48:00.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 93.744959ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15112024-12-18T19:48:00.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 868.707211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
15122024-12-18T19:48:00.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 235.858821ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15132024-12-18T19:48:00.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 118.284431ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15142024-12-18T19:48:00.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 827.480043ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15152024-12-18T19:48:00.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 271.138553ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15162024-12-18T19:48:00.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.202442063s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
15172024-12-18T19:48:00.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 890.139368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15182024-12-18T19:48:00.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 348.27087ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15192024-12-18T19:48:00.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 551.519151ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
15202024-12-18T19:48:00.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 919.525759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
15212024-12-18T19:48:00.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.09388997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
15222024-12-18T19:48:00.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 440.861161ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15232024-12-18T19:48:00.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 621.083189ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
15242024-12-18T19:48:00.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 465.192669ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15252024-12-18T19:48:00.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.028537553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15262024-12-18T19:48:00.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 958.893859ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15272024-12-18T19:48:00.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.34867777s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
15282024-12-18T19:48:00.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.243695204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
15292024-12-18T19:48:00.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 477.256875ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15302024-12-18T19:48:01.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.33754835s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
15312024-12-18T19:48:01.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 828.606822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
15322024-12-18T19:48:01.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 655.697709ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15332024-12-18T19:48:01.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 804.305616ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15342024-12-18T19:48:01.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 577.189612ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
15352024-12-18T19:48:01.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 536.144148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15362024-12-18T19:48:01.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 757.381025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
15372024-12-18T19:48:01.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 971.267936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
15382024-12-18T19:48:01.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.108433715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
15392024-12-18T19:48:01.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.289989209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
15402024-12-18T19:48:01.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 724.344789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
15412024-12-18T19:48:01.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.379709817s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15422024-12-18T19:48:01.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 735.593646ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
15432024-12-18T19:48:01.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.066153439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
15442024-12-18T19:48:01.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 975.037909ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15452024-12-18T19:48:01.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.145595295s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15462024-12-18T19:48:01.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 724.370449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15472024-12-18T19:48:01.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 976.252742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15482024-12-18T19:48:01.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 578.325207ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
15492024-12-18T19:48:01.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 656.527686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
15502024-12-18T19:48:01.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 868.021957ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15512024-12-18T19:48:02.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 923.212103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
15522024-12-18T19:48:02.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 780.653347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
15532024-12-18T19:48:02.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 953.435055ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
15542024-12-18T19:48:02.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 908.566687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
15552024-12-18T19:48:02.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 668.401772ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
15562024-12-18T19:48:02.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.488938543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
15572024-12-18T19:48:02.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 902.833116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
15582024-12-18T19:48:02.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 984.776434ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
15592024-12-18T19:48:02.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.482665972s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
15602024-12-18T19:48:02.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.151711555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15612024-12-18T19:48:02.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.437353965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
15622024-12-18T19:48:02.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.420078256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
15632024-12-18T19:48:02.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.264289936s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
15642024-12-18T19:48:02.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 703.95185ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15652024-12-18T19:48:02.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 736.043809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15662024-12-18T19:48:02.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 584.636705ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15672024-12-18T19:48:02.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.097347906s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15682024-12-18T19:48:02.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 804.857272ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15692024-12-18T19:48:02.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 977.895552ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
15702024-12-18T19:48:02.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.202232393s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
15712024-12-18T19:48:02.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.436466649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
15722024-12-18T19:48:03.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 665.657844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
15732024-12-18T19:48:03.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 509.140003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
15742024-12-18T19:48:03.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.163490335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
15752024-12-18T19:48:03.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.30141624s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
15762024-12-18T19:48:03.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 569.659005ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15772024-12-18T19:48:03.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.468658082s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
15782024-12-18T19:48:03.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 787.264458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15792024-12-18T19:48:03.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 961.905012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
15802024-12-18T19:48:03.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 606.957008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15812024-12-18T19:48:03.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.04591956s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
15822024-12-18T19:48:03.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.427952401s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
15832024-12-18T19:48:03.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 718.135894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
15842024-12-18T19:48:03.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.286284512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
15852024-12-18T19:48:03.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 581.015257ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15862024-12-18T19:48:04.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 691.791154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
15872024-12-18T19:48:04.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.029524151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
15882024-12-18T19:48:04.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 716.896843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
15892024-12-18T19:48:04.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 867.517738ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
15902024-12-18T19:48:04.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 806.377253ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
15912024-12-18T19:48:04.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 572.448799ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
15922024-12-18T19:48:04.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.317688547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
15932024-12-18T19:48:04.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.183479636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
15942024-12-18T19:48:04.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.360671615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
15952024-12-18T19:48:04.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.089429044s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
15962024-12-18T19:48:04.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.441622924s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
15972024-12-18T19:48:04.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.204359023s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
15982024-12-18T19:48:04.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.176811533s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
15992024-12-18T19:48:04.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 823.379811ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
16002024-12-18T19:48:04.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.04852087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16012024-12-18T19:48:04.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 934.35458ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16022024-12-18T19:48:04.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 526.985939ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
16032024-12-18T19:48:04.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 954.881444ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16042024-12-18T19:48:04.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.411942668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
16052024-12-18T19:48:05.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 862.536871ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16062024-12-18T19:48:05.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 966.695351ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
16072024-12-18T19:48:05.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.275844772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
16082024-12-18T19:48:05.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 557.399177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16092024-12-18T19:48:05.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 753.403234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
16102024-12-18T19:48:05.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 986.151751ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
16112024-12-18T19:48:05.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.441723817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
16122024-12-18T19:48:05.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.08913071s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
16132024-12-18T19:48:05.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 561.77885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16142024-12-18T19:48:05.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.314152912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
16152024-12-18T19:48:05.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 806.068232ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16162024-12-18T19:48:05.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 701.470756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16172024-12-18T19:48:05.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.12912068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
16182024-12-18T19:48:05.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 714.928594ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16192024-12-18T19:48:05.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.217798807s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16202024-12-18T19:48:05.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.423245235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
16212024-12-18T19:48:05.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 883.033596ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
16222024-12-18T19:48:05.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.235068914s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16232024-12-18T19:48:05.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.069971695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
16242024-12-18T19:48:06.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 975.361449ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
16252024-12-18T19:48:06.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 814.784893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
16262024-12-18T19:48:06.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 591.802027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16272024-12-18T19:48:06.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.175213216s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
16282024-12-18T19:48:06.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.205462302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
16292024-12-18T19:48:06.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 693.676056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
16302024-12-18T19:48:06.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 530.717545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16312024-12-18T19:48:06.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 717.801841ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16322024-12-18T19:48:06.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 681.573076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16332024-12-18T19:48:06.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.445502546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
16342024-12-18T19:48:06.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 575.956081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
16352024-12-18T19:48:06.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 703.335361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16362024-12-18T19:48:06.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 656.270873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
16372024-12-18T19:48:06.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.007655867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
16382024-12-18T19:48:06.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 637.818163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
16392024-12-18T19:48:07.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.193842827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
16402024-12-18T19:48:07.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.407343673s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
16412024-12-18T19:48:07.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 886.743096ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16422024-12-18T19:48:07.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 704.097698ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16432024-12-18T19:48:07.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 519.992782ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16442024-12-18T19:48:07.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 705.761138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
16452024-12-18T19:48:07.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 795.333248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
16462024-12-18T19:48:07.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.428612356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
16472024-12-18T19:48:07.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 630.266566ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16482024-12-18T19:48:07.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.497037752s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
16492024-12-18T19:48:07.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.432053166s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
16502024-12-18T19:48:07.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 877.323979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16512024-12-18T19:48:07.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.106039535s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
16522024-12-18T19:48:07.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 559.540117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16532024-12-18T19:48:07.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.478536426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
16542024-12-18T19:48:07.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.480953606s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
16552024-12-18T19:48:07.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.425135047s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16562024-12-18T19:48:07.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 668.644425ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16572024-12-18T19:48:07.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 592.262699ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
16582024-12-18T19:48:08.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.288157016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16592024-12-18T19:48:08.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.092488535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
16602024-12-18T19:48:08.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 866.918769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
16612024-12-18T19:48:08.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.373979351s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16622024-12-18T19:48:08.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.314046478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
16632024-12-18T19:48:08.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 909.398401ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
16642024-12-18T19:48:08.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 781.626218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16652024-12-18T19:48:08.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.335494065s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
16662024-12-18T19:48:08.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.411074418s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
16672024-12-18T19:48:08.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 723.231697ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16682024-12-18T19:48:08.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.360562567s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16692024-12-18T19:48:08.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.326034002s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
16702024-12-18T19:48:08.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 532.686952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
16712024-12-18T19:48:08.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 501.06314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
16722024-12-18T19:48:09.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.102088079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
16732024-12-18T19:48:09.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.378561227s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
16742024-12-18T19:48:09.118ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16752024-12-18T19:48:09.118ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
16762024-12-18T19:48:09.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.279862897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
16772024-12-18T19:48:09.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.225025229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
16782024-12-18T19:48:09.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.094973707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
16792024-12-18T19:48:09.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 753.665035ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16802024-12-18T19:48:09.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 649.47248ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
16812024-12-18T19:48:09.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 977.655078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
16822024-12-18T19:48:09.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 46.431891ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
16832024-12-18T19:48:09.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 736.653921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16842024-12-18T19:48:09.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 538.49301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16852024-12-18T19:48:09.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 78.839046ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
16862024-12-18T19:48:09.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.021644075s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
16872024-12-18T19:48:09.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 169.557465ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
16882024-12-18T19:48:09.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.368401657s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
16892024-12-18T19:48:09.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 862.317192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
16902024-12-18T19:48:09.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.324210002s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
16912024-12-18T19:48:09.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 506.032069ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
16922024-12-18T19:48:09.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 811.32105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
16932024-12-18T19:48:09.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.42323295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
16942024-12-18T19:48:09.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.390863835s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
16952024-12-18T19:48:09.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.020115903s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
16962024-12-18T19:48:10.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.480792916s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
16972024-12-18T19:48:10.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 866.02298ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
16982024-12-18T19:48:10.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.142924737s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
16992024-12-18T19:48:10.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 508.225557ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17002024-12-18T19:48:10.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.113557234s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17012024-12-18T19:48:10.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.464670965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
17022024-12-18T19:48:10.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.293936238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17032024-12-18T19:48:10.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.009964586s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
17042024-12-18T19:48:10.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 664.115213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17052024-12-18T19:48:10.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 676.899973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17062024-12-18T19:48:10.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 800.026879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17072024-12-18T19:48:10.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.277120908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
17082024-12-18T19:48:10.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 572.795186ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17092024-12-18T19:48:10.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 502.778673ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17102024-12-18T19:48:10.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 742.882421ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17112024-12-18T19:48:10.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.012353104s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
17122024-12-18T19:48:10.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 688.067735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
17132024-12-18T19:48:10.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.170554018s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
17142024-12-18T19:48:11.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.481403302s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
17152024-12-18T19:48:11.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 904.876354ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17162024-12-18T19:48:11.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 860.561847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17172024-12-18T19:48:11.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 507.365084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17182024-12-18T19:48:11.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 713.932216ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17192024-12-18T19:48:11.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 927.154632ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
17202024-12-18T19:48:11.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 855.257842ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17212024-12-18T19:48:11.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.375708927s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17222024-12-18T19:48:11.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.102390938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
17232024-12-18T19:48:11.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 534.197178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
17242024-12-18T19:48:11.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.438232483s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
17252024-12-18T19:48:11.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 542.748625ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17262024-12-18T19:48:11.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.228420621s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
17272024-12-18T19:48:11.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 742.356377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17282024-12-18T19:48:11.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.254466793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
17292024-12-18T19:48:11.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.156162926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17302024-12-18T19:48:11.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 925.483726ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
17312024-12-18T19:48:11.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.258113908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
17322024-12-18T19:48:11.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.399618123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
17332024-12-18T19:48:11.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 745.203921ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17342024-12-18T19:48:11.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.328816146s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
17352024-12-18T19:48:11.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 877.829136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17362024-12-18T19:48:11.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 852.291111ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17372024-12-18T19:48:11.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 546.646075ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17382024-12-18T19:48:12.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.084848186s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
17392024-12-18T19:48:12.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.137600824s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17402024-12-18T19:48:12.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 962.167996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
17412024-12-18T19:48:12.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 990.207469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17422024-12-18T19:48:12.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.113185591s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
17432024-12-18T19:48:12.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.458025405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
17442024-12-18T19:48:12.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.352728429s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17452024-12-18T19:48:12.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.17331086s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
17462024-12-18T19:48:12.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.281507416s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17472024-12-18T19:48:12.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 529.661252ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17482024-12-18T19:48:12.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.208295345s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
17492024-12-18T19:48:12.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 502.063616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17502024-12-18T19:48:12.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 910.167736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
17512024-12-18T19:48:12.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 686.595784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17522024-12-18T19:48:12.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 847.658325ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17532024-12-18T19:48:12.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 840.694745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
17542024-12-18T19:48:13.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.280078219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
17552024-12-18T19:48:13.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.353270788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
17562024-12-18T19:48:13.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.332238382s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
17572024-12-18T19:48:13.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 879.247273ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17582024-12-18T19:48:13.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.264474682s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
17592024-12-18T19:48:13.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 822.40882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17602024-12-18T19:48:13.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.256543624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
17612024-12-18T19:48:13.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 613.800882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17622024-12-18T19:48:13.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 676.815515ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17632024-12-18T19:48:13.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 540.992805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17642024-12-18T19:48:13.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.36580181s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
17652024-12-18T19:48:13.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.113426952s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17662024-12-18T19:48:13.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.303873649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
17672024-12-18T19:48:13.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.472734058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
17682024-12-18T19:48:13.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.007323422s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
17692024-12-18T19:48:13.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.226113439s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17702024-12-18T19:48:13.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 865.147306ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17712024-12-18T19:48:13.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 649.790075ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17722024-12-18T19:48:13.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.399521275s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
17732024-12-18T19:48:13.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.045433148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
17742024-12-18T19:48:14.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 618.610019ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17752024-12-18T19:48:14.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.243510827s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17762024-12-18T19:48:14.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 867.098531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17772024-12-18T19:48:14.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.070962308s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17782024-12-18T19:48:14.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 741.237696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
17792024-12-18T19:48:14.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.291616945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
17802024-12-18T19:48:14.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.375976661s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
17812024-12-18T19:48:14.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.481219745s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
17822024-12-18T19:48:14.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.446803729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
17832024-12-18T19:48:14.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 663.091625ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17842024-12-18T19:48:14.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.058132741s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
17852024-12-18T19:48:14.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.291688652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
17862024-12-18T19:48:14.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.125954267s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
17872024-12-18T19:48:14.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.135590003s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
17882024-12-18T19:48:14.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 993.438717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
17892024-12-18T19:48:14.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.168652958s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
17902024-12-18T19:48:15.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.352368287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
17912024-12-18T19:48:15.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 958.026912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
17922024-12-18T19:48:15.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 533.210191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
17932024-12-18T19:48:15.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 843.218671ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
17942024-12-18T19:48:15.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.422319148s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
17952024-12-18T19:48:15.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 644.112909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
17962024-12-18T19:48:15.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.383735774s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
17972024-12-18T19:48:15.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 922.046099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
17982024-12-18T19:48:15.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.339250884s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
17992024-12-18T19:48:15.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.126814315s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
18002024-12-18T19:48:15.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 909.852279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
18012024-12-18T19:48:15.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.080071712s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18022024-12-18T19:48:15.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.029548233s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18032024-12-18T19:48:15.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 951.869481ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
18042024-12-18T19:48:15.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 680.167377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18052024-12-18T19:48:15.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.233299131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18062024-12-18T19:48:15.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 629.557378ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
18072024-12-18T19:48:15.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 1.339613334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
18082024-12-18T19:48:16.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.191464115s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
18092024-12-18T19:48:16.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 685.5149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18102024-12-18T19:48:16.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 736.481657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18112024-12-18T19:48:16.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 846.897053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
18122024-12-18T19:48:16.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 899.163976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
18132024-12-18T19:48:16.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.156320938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18142024-12-18T19:48:16.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.319914472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
18152024-12-18T19:48:16.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 839.654451ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
18162024-12-18T19:48:16.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 694.787737ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18172024-12-18T19:48:16.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.124313963s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18182024-12-18T19:48:16.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 618.953123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
18192024-12-18T19:48:16.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.078226233s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
18202024-12-18T19:48:16.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.271277027s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18212024-12-18T19:48:16.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.047672023s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
18222024-12-18T19:48:16.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 848.796613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
18232024-12-18T19:48:16.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 738.509896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18242024-12-18T19:48:16.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 635.276395ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
18252024-12-18T19:48:16.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.291678894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18262024-12-18T19:48:16.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 604.703758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18272024-12-18T19:48:16.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.464175237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
18282024-12-18T19:48:17.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 954.337789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
18292024-12-18T19:48:17.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.437021716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18302024-12-18T19:48:17.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.496698531s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
18312024-12-18T19:48:17.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 762.804129ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
18322024-12-18T19:48:17.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 993.542276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18332024-12-18T19:48:17.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 800.133541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
18342024-12-18T19:48:17.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.036444821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18352024-12-18T19:48:17.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.408250676s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
18362024-12-18T19:48:17.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 546.251763ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
18372024-12-18T19:48:17.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 870.088682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18382024-12-18T19:48:17.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.214539728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18392024-12-18T19:48:17.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.337259923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
18402024-12-18T19:48:17.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d") failed: Property not found. retry in 1.347658771s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
18412024-12-18T19:48:17.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.227316368s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
18422024-12-18T19:48:17.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 794.397529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18432024-12-18T19:48:17.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.216594391s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
18442024-12-18T19:48:17.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 631.518136ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18452024-12-18T19:48:18.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.488270834s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
18462024-12-18T19:48:18.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02") failed: Property not found. retry in 1.225877377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
18472024-12-18T19:48:18.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 1.295710497s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
18482024-12-18T19:48:18.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 585.942826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
18492024-12-18T19:48:18.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 638.435955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18502024-12-18T19:48:18.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 891.781618ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18512024-12-18T19:48:18.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 888.935674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18522024-12-18T19:48:18.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 1.426854452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
18532024-12-18T19:48:18.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 682.601738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18542024-12-18T19:48:18.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.301209685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18552024-12-18T19:48:18.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.066990933s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18562024-12-18T19:48:18.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 583.500398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18572024-12-18T19:48:18.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.166630898s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
18582024-12-18T19:48:18.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8") failed: Property not found. retry in 810.599869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
18592024-12-18T19:48:18.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 1.369530379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18602024-12-18T19:48:18.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 531.980571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18612024-12-18T19:48:18.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f") failed: Property not found. retry in 1.347556176s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
18622024-12-18T19:48:18.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.290772444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
18632024-12-18T19:48:19.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.080670864s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
18642024-12-18T19:48:19.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 1.077561828s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
18652024-12-18T19:48:19.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 1.100727504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18662024-12-18T19:48:19.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 662.336919ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18672024-12-18T19:48:19.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.062855967s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18682024-12-18T19:48:19.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 668.94001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18692024-12-18T19:48:19.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388") failed: Property not found. retry in 885.371307ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
18702024-12-18T19:48:19.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.448088674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18712024-12-18T19:48:19.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 687.981241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
18722024-12-18T19:48:19.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 535.727489ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18732024-12-18T19:48:19.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 910.283671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
18742024-12-18T19:48:19.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 849.005336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18752024-12-18T19:48:19.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70") failed: Property not found. retry in 1.102804307s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
18762024-12-18T19:48:19.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 674.56821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18772024-12-18T19:48:20.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 847.195241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18782024-12-18T19:48:20.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe") failed: Property not found. retry in 1.306555977s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
18792024-12-18T19:48:20.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667") failed: Property not found. retry in 720.108621ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
18802024-12-18T19:48:20.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 606.648325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18812024-12-18T19:48:20.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0") failed: Property not found. retry in 1.150010611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
18822024-12-18T19:48:20.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06") failed: Property not found. retry in 1.244661445s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
18832024-12-18T19:48:20.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47") failed: Property not found. retry in 1.024759286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
18842024-12-18T19:48:20.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344") failed: Property not found. retry in 693.429731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18852024-12-18T19:48:20.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 517.913983ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18862024-12-18T19:48:20.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2") failed: Property not found. retry in 1.294231161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18872024-12-18T19:48:20.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade") failed: Property not found. retry in 1.4226906s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
18882024-12-18T19:48:20.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446") failed: Property not found. retry in 741.127641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
18892024-12-18T19:48:20.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09") failed: Property not found. retry in 847.270722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
18902024-12-18T19:48:20.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e62e166d-3195-4993-9658-25854943a145") failed: Property not found. retry in 1.335179134s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18912024-12-18T19:48:20.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798") failed: Property not found. retry in 1.358987832s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
18922024-12-18T19:48:20.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b") failed: Property not found. retry in 1.18170494s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18932024-12-18T19:48:22.265ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e62e166d-3195-4993-9658-25854943a145
18942024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_9da4e3ea-a57c-4b2b-81c3-7f374155d667
18952024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_561cdd3b-973b-469c-9ddc-cc0204a9e8e2
18962024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c17822b5-dd64-4e7f-adf2-30dae16c4344
18972024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_1139ebda-6055-49a8-8243-f0019044de70
18982024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_d62a7c10-1ef0-4907-b646-cd126a8e8a9b
18992024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_8d7103cd-7f05-41c9-b8dd-116e6f988ade
19002024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_91754436-1534-4d5c-942f-012e90fd9ab0
19012024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_882b5f00-9810-42db-845d-5c19147b5f47
19022024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_2a7637c0-f465-4032-a837-76ff2b185388
19032024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_35cf0d92-c4e4-4a09-8523-a18ec4d945a8
19042024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_64813786-f895-4d99-97f3-a8f85331321d
19052024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_3204ca74-ea13-4042-a075-6a8d1de2ee02
19062024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_e8590144-bfff-4d2e-aa70-065d47db3a0f
19072024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_5089823b-255d-4f80-8f09-55f4e892bd09
19082024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2d5b2421-8a1b-401d-bfda-767ed2a1f446
19092024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_a2a39b25-b465-4521-a2e8-e7c9c0ee0dfe
19102024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_acf239d0-d637-4ea6-98b7-7e82b5951798
19112024-12-18T19:48:22.266ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_4e3d8b46-b399-4d3c-bc66-63409f4abd06
19122024-12-18T19:48:22.268ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
19132024-12-18T19:48:22.273ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
19142024-12-18T19:48:22.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39113379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43674 req_id = f1fd3b05-4d79-4f4d-9149-9d2a5a5787d4 response_code = 204 uri = /omicron-zones
19152024-12-18T19:48:22.318ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
19162024-12-18T19:48:22.574ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
19172024-12-18T19:48:22.577ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:802
19182024-12-18T19:48:22.623ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
19192024-12-18T19:48:25.096ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 95.64931582s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19202024-12-18T19:48:25.435ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/nexus.rs:527 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19212024-12-18T19:48:26.031ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19222024-12-18T19:48:26.125ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19232024-12-18T19:48:26.305ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19242024-12-18T19:48:26.448ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19252024-12-18T19:48:26.553ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/nexus.rs:527 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19262024-12-18T19:48:26.627ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19272024-12-18T19:48:26.769ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19282024-12-18T19:48:26.800ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62533
19292024-12-18T19:48:26.813ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4905 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62533 req_id = e10fdc20-f571-419a-872e-93654546be3c response_code = 200 uri = /baseboard
19302024-12-18T19:48:27.075ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19312024-12-18T19:48:27.255ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19322024-12-18T19:48:27.546ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19332024-12-18T19:48:27.887ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19342024-12-18T19:48:28.162ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19352024-12-18T19:48:28.535ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/nexus.rs:527 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19362024-12-18T19:48:28.691ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/58ee29db-9185-4216-97e8-559d204ec1d2) file = sled-agent/src/probe_manager.rs:231 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19372024-12-18T19:48:28.810ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/460eefc4-cff7-4f04-b6cb-c443459a12a5/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
19382024-12-18T19:48:31.596ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "952d5936-369a-4cc4-a47c-3b9965234873", "content-length": "173", "date": "Wed, 18 Dec 2024 19:48:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"460eefc4-cff7-4f04-b6cb-c443459a12a5\"", request_id: "952d5936-369a-4cc4-a47c-3b9965234873" } file = sled-agent/src/rack_setup/service.rs:1078
19392024-12-18T19:48:32.214ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b31a608a-8d04-4234-8aed-2abbbb473215", "content-length": "173", "date": "Wed, 18 Dec 2024 19:48:31 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"460eefc4-cff7-4f04-b6cb-c443459a12a5\"", request_id: "b31a608a-8d04-4234-8aed-2abbbb473215" } file = sled-agent/src/rack_setup/service.rs:1078
19402024-12-18T19:48:32.693ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
19412024-12-18T19:48:33.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53196
19422024-12-18T19:48:33.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5603 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53196 req_id = 9b226c0f-a509-4ea7-a37d-165b171691d0 response_code = 200 uri = /vpc-routes
19432024-12-18T19:48:33.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64972
19442024-12-18T19:48:33.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64972 req_id = 98075b9d-1c8e-4fb7-b601-fda18723a73d response_code = 200 uri = /vpc-routes
19452024-12-18T19:48:33.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37318
19462024-12-18T19:48:33.873ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19472024-12-18T19:48:33.874ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19482024-12-18T19:48:33.875ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
19492024-12-18T19:48:33.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
19502024-12-18T19:48:33.894ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19512024-12-18T19:48:33.894ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
19522024-12-18T19:48:33.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
19532024-12-18T19:48:33.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3760 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64972 req_id = e4c7baeb-ede3-4c35-a44f-0d848a659a6b response_code = 204 uri = /eip-gateways
19542024-12-18T19:48:33.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
19552024-12-18T19:48:33.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53196 req_id = 31122a31-7fa6-4ceb-a09b-3e85bf95b512 response_code = 204 uri = /eip-gateways
19562024-12-18T19:48:33.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36112
19572024-12-18T19:48:33.929ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19582024-12-18T19:48:33.929ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19592024-12-18T19:48:33.929ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
19602024-12-18T19:48:33.929ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19612024-12-18T19:48:33.929ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
19622024-12-18T19:48:33.935ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
19632024-12-18T19:48:33.953ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19642024-12-18T19:48:33.953ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
19652024-12-18T19:48:33.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19662024-12-18T19:48:33.977ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
19672024-12-18T19:48:34.012ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19682024-12-18T19:48:34.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
19692024-12-18T19:48:34.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53384
19702024-12-18T19:48:34.029ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19712024-12-18T19:48:34.029ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
19722024-12-18T19:48:34.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58791
19732024-12-18T19:48:34.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58791 req_id = e4f029e8-67ed-4764-b1d9-9becd7f67ba8 response_code = 200 uri = /vpc-routes
19742024-12-18T19:48:34.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19752024-12-18T19:48:34.053ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19762024-12-18T19:48:34.053ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19772024-12-18T19:48:34.053ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
19782024-12-18T19:48:34.053ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
19792024-12-18T19:48:34.064ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
19802024-12-18T19:48:34.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19812024-12-18T19:48:34.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
19822024-12-18T19:48:34.105ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19832024-12-18T19:48:34.105ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
19842024-12-18T19:48:34.132ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19852024-12-18T19:48:34.132ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
19862024-12-18T19:48:34.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
19872024-12-18T19:48:34.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58791 req_id = 17a03d16-2c34-4f46-bb34-e22ff5085292 response_code = 204 uri = /eip-gateways
19882024-12-18T19:48:34.152ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19892024-12-18T19:48:34.152ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
19902024-12-18T19:48:34.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52293
19912024-12-18T19:48:34.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14009 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64972 req_id = cb5ffff0-15c0-4343-8478-e255f7c22b2c response_code = 204 uri = /vpc-routes
19922024-12-18T19:48:34.170ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 3 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 3 } subnet = RouterId { vni: Vni(100), kind: System }
19932024-12-18T19:48:34.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53196 req_id = 8ce3d391-c96a-4404-bae2-14c20671ba60 response_code = 204 uri = /vpc-routes
19942024-12-18T19:48:34.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19952024-12-18T19:48:34.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
19962024-12-18T19:48:34.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9998 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52293 req_id = a18750c2-0b58-41e8-b265-10ee23bf44cf response_code = 200 uri = /v2p
19972024-12-18T19:48:34.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36910
19982024-12-18T19:48:34.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36910 req_id = 1fb05857-d9fc-4dcc-9933-c375a450e795 response_code = 200 uri = /v2p
19992024-12-18T19:48:34.197ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20002024-12-18T19:48:34.197ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
20012024-12-18T19:48:34.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41458
20022024-12-18T19:48:34.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41458 req_id = 385df063-4d90-4221-b9db-39af9aa8a7fd response_code = 200 uri = /v2p
20032024-12-18T19:48:34.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20042024-12-18T19:48:34.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
20052024-12-18T19:48:34.238ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20062024-12-18T19:48:34.238ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
20072024-12-18T19:48:34.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20082024-12-18T19:48:34.259ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
20092024-12-18T19:48:34.275ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20102024-12-18T19:48:34.275ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
20112024-12-18T19:48:34.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20122024-12-18T19:48:34.292ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
20132024-12-18T19:48:34.311ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20142024-12-18T19:48:34.311ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
20152024-12-18T19:48:34.319ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 3 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 3 } subnet = RouterId { vni: Vni(100), kind: System }
20162024-12-18T19:48:34.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1031 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58791 req_id = d6a58d91-6fd6-4a8d-bdb3-ef07fbefd482 response_code = 204 uri = /vpc-routes
20172024-12-18T19:48:34.329ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20182024-12-18T19:48:34.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
20192024-12-18T19:48:34.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37318 req_id = 8730a6c9-9cc9-47de-95e1-0f3c2109f111 response_code = 200 uri = /inventory
20202024-12-18T19:48:34.344ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20212024-12-18T19:48:34.344ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
20222024-12-18T19:48:34.360ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20232024-12-18T19:48:34.360ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
20242024-12-18T19:48:34.379ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20252024-12-18T19:48:34.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
20262024-12-18T19:48:34.398ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20272024-12-18T19:48:34.398ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
20282024-12-18T19:48:34.417ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20292024-12-18T19:48:34.417ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
20302024-12-18T19:48:34.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493397 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36112 req_id = 1d403cd5-d93e-45bb-9e4a-9aa0f21acfcf response_code = 200 uri = /inventory
20312024-12-18T19:48:34.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20322024-12-18T19:48:34.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
20332024-12-18T19:48:34.472ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20342024-12-18T19:48:34.472ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
20352024-12-18T19:48:34.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 461622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53384 req_id = e80df15a-18de-4dbd-8ece-122f8414b7ed response_code = 200 uri = /inventory
20362024-12-18T19:48:35.397ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42003
20372024-12-18T19:48:35.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20382024-12-18T19:48:35.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20392024-12-18T19:48:35.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
20402024-12-18T19:48:35.398ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
20412024-12-18T19:48:35.410ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20422024-12-18T19:48:35.410ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
20432024-12-18T19:48:35.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20442024-12-18T19:48:35.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
20452024-12-18T19:48:35.469ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20462024-12-18T19:48:35.469ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
20472024-12-18T19:48:35.499ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20482024-12-18T19:48:35.499ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
20492024-12-18T19:48:35.526ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20502024-12-18T19:48:35.526ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
20512024-12-18T19:48:35.554ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20522024-12-18T19:48:35.554ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
20532024-12-18T19:48:35.582ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20542024-12-18T19:48:35.582ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
20552024-12-18T19:48:35.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45235
20562024-12-18T19:48:35.608ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20572024-12-18T19:48:35.608ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
20582024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20592024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20602024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20612024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20622024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20632024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20642024-12-18T19:48:35.614ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20652024-12-18T19:48:35.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7932 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45235 req_id = e9f292c6-02d9-4466-96f3-95373541bd2a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20662024-12-18T19:48:35.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55251
20672024-12-18T19:48:35.623ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20682024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20692024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20702024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20712024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20722024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20732024-12-18T19:48:35.624ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20742024-12-18T19:48:35.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3342 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55251 req_id = 90ffa725-a544-4eb9-b51d-bb49398d6e81 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20752024-12-18T19:48:35.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20762024-12-18T19:48:35.632ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
20772024-12-18T19:48:35.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53463
20782024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20792024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20802024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20812024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20822024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20832024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20842024-12-18T19:48:35.638ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20852024-12-18T19:48:35.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 395 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53463 req_id = a65f724d-de30-40e2-9961-ddf3008610b7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20862024-12-18T19:48:35.639ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
20872024-12-18T19:48:35.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
20882024-12-18T19:48:35.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
20892024-12-18T19:48:35.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247969 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42003 req_id = c2ce3f23-f930-438c-ba21-2bbf7db5cf4e response_code = 200 uri = /inventory
20902024-12-18T19:48:36.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40551
20912024-12-18T19:48:36.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20922024-12-18T19:48:36.049ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
20932024-12-18T19:48:36.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
20942024-12-18T19:48:36.049ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
20952024-12-18T19:48:36.062ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20962024-12-18T19:48:36.062ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
20972024-12-18T19:48:36.089ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
20982024-12-18T19:48:36.089ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
20992024-12-18T19:48:36.114ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21002024-12-18T19:48:36.114ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
21012024-12-18T19:48:36.140ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21022024-12-18T19:48:36.140ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
21032024-12-18T19:48:36.163ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21042024-12-18T19:48:36.163ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
21052024-12-18T19:48:36.188ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21062024-12-18T19:48:36.188ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
21072024-12-18T19:48:36.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21082024-12-18T19:48:36.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
21092024-12-18T19:48:36.234ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21102024-12-18T19:48:36.234ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
21112024-12-18T19:48:36.256ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
21122024-12-18T19:48:36.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
21132024-12-18T19:48:36.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220436 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40551 req_id = bb1d8c88-8bf0-457a-a96f-757227cff1cc response_code = 200 uri = /inventory
21142024-12-18T19:48:37.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48841
21152024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21162024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21172024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21182024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21192024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21202024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21212024-12-18T19:48:37.103ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21222024-12-18T19:48:37.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48841 req_id = d3ff499d-dcb2-4254-89c6-8a88ac5ce8ab response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21232024-12-18T19:48:40.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58120
21242024-12-18T19:48:40.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58120 req_id = 37896f39-ff2a-4c95-bc35-babf564b8bb8 response_code = 200 uri = /vpc-routes
21252024-12-18T19:48:41.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21262024-12-18T19:48:41.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58120 req_id = b276924d-9102-478f-990e-20bf70ce9043 response_code = 204 uri = /eip-gateways
21272024-12-18T19:48:41.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58120 req_id = 14dc09f6-90be-4688-ab26-5fd93afd1ea5 response_code = 204 uri = /vpc-routes
21282024-12-18T19:48:56.864ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60184
21292024-12-18T19:48:56.864ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60184 req_id = cb7119e1-3a71-4f1d-948e-46f8f8a6114a response_code = 200 uri = /baseboard
21302024-12-18T19:49:03.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35844
21312024-12-18T19:49:03.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35844 req_id = 37f8b580-a495-4395-a84a-0e2d9ac29c70 response_code = 200 uri = /vpc-routes
21322024-12-18T19:49:03.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42451
21332024-12-18T19:49:03.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42451 req_id = c8002319-12d0-454d-af86-6149a5ee39b2 response_code = 200 uri = /vpc-routes
21342024-12-18T19:49:03.588ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21352024-12-18T19:49:03.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42451 req_id = daf39484-e6f9-429c-8dc8-fcacc0ce9d85 response_code = 204 uri = /eip-gateways
21362024-12-18T19:49:03.594ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21372024-12-18T19:49:03.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35844 req_id = dfbb5d04-6077-4be5-8499-c1ac81c96aad response_code = 204 uri = /eip-gateways
21382024-12-18T19:49:03.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42451 req_id = c0192712-45cf-4062-8e04-c793f84fdf94 response_code = 204 uri = /vpc-routes
21392024-12-18T19:49:03.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35844 req_id = d09e73b0-e7a3-494c-84fd-b4cb254e297f response_code = 204 uri = /vpc-routes
21402024-12-18T19:49:03.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33694
21412024-12-18T19:49:03.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21422024-12-18T19:49:03.850ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21432024-12-18T19:49:03.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33694 req_id = e64f9cd7-18cd-4748-a443-ff6e8b56bd66 response_code = 204 uri = /switch-ports
21442024-12-18T19:49:03.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62510
21452024-12-18T19:49:03.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45767
21462024-12-18T19:49:03.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49612
21472024-12-18T19:49:03.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45742
21482024-12-18T19:49:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49612 req_id = 98f970f4-f367-4603-8784-0c36e6fa0520 response_code = 200 uri = /v2p
21492024-12-18T19:49:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 809 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45742 req_id = ddc03121-3778-47ef-90ae-3ff18c62b574 response_code = 200 uri = /vpc-routes
21502024-12-18T19:49:03.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21512024-12-18T19:49:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45767 req_id = d13f5033-2fcc-4290-bf12-d558908c8af2 response_code = 200 uri = /v2p
21522024-12-18T19:49:03.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33694 req_id = fa9783fc-8b38-44e1-be7d-b2eb3b9bcb37 response_code = 200 uri = /network-bootstore-config
21532024-12-18T19:49:03.983ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56047
21542024-12-18T19:49:03.983ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56047 req_id = 3184e944-27fe-4408-bd54-0a1034074d58 response_code = 200 uri = /v2p
21552024-12-18T19:49:03.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21562024-12-18T19:49:04.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21572024-12-18T19:49:04.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 761 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45742 req_id = 778a6095-c20e-4271-8bba-757267eacd99 response_code = 204 uri = /eip-gateways
21582024-12-18T19:49:04.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 900 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45742 req_id = c0fa3f96-a3a6-4d96-92c1-820c3f3076cd response_code = 204 uri = /vpc-routes
21592024-12-18T19:49:04.024ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
21602024-12-18T19:49:04.024ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f1657089-065e-4651-a353-e5d94949a179/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
21612024-12-18T19:49:04.026ZINFOSledAgent (bootstore): Writing ledger to /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
21622024-12-18T19:49:04.027ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
21632024-12-18T19:49:04.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6487 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33694 req_id = 7a149539-5bc6-4ffa-9cb7-81560f8c9f64 response_code = 204 uri = /network-bootstore-config
21642024-12-18T19:49:04.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62510 req_id = abe2fdff-e73b-4037-83ac-627441bdb2cf response_code = 204 uri = /switch-ports
21652024-12-18T19:49:04.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62510 req_id = ea2e1c71-49bb-41b2-ab35-285e4e6c23d7 response_code = 200 uri = /network-bootstore-config
21662024-12-18T19:49:04.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65414
21672024-12-18T19:49:04.078ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21682024-12-18T19:49:04.116ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21692024-12-18T19:49:04.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92936 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65414 req_id = 1fc80714-d66c-4d38-881b-74fdffcb5cb3 response_code = 204 uri = /switch-ports
21702024-12-18T19:49:04.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65414 req_id = 6d4f035c-87f2-4e8e-90f8-3b52afc11146 response_code = 200 uri = /network-bootstore-config
21712024-12-18T19:49:26.898ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45472
21722024-12-18T19:49:26.898ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45472 req_id = 3d3567b2-0dfc-4fd0-bf6d-ac4584256f05 response_code = 200 uri = /baseboard
21732024-12-18T19:49:33.501ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
21742024-12-18T19:49:33.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63508
21752024-12-18T19:49:33.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63508 req_id = f5088a02-e8c5-438a-8aef-7f8128c3dcd7 response_code = 200 uri = /vpc-routes
21762024-12-18T19:49:33.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60731
21772024-12-18T19:49:33.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60731 req_id = 376b0348-79cd-49e4-94b3-225de2ce4e13 response_code = 200 uri = /vpc-routes
21782024-12-18T19:49:33.823ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21792024-12-18T19:49:33.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60731 req_id = a4aeee17-3172-4720-8d0c-d1c0ceff149a response_code = 204 uri = /eip-gateways
21802024-12-18T19:49:33.824ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50566
21812024-12-18T19:49:33.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50566 req_id = df144c4f-5e60-4c2b-94fd-cd9f6aa53cb6 response_code = 200 uri = /v2p
21822024-12-18T19:49:33.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60731 req_id = 36c5463d-9c2f-407d-9aeb-f1b1da416cb2 response_code = 204 uri = /vpc-routes
21832024-12-18T19:49:33.859ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
21842024-12-18T19:49:33.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63508 req_id = 1dd4d608-977d-4c92-b0a8-6785329f2403 response_code = 204 uri = /eip-gateways
21852024-12-18T19:49:33.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34677
21862024-12-18T19:49:33.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34677 req_id = c67cc0dc-e55f-490f-85fb-d16b0960a010 response_code = 200 uri = /v2p
21872024-12-18T19:49:33.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63508 req_id = 69309515-53a0-4385-8a46-9b32e8194d0e response_code = 204 uri = /vpc-routes
21882024-12-18T19:49:33.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54990
21892024-12-18T19:49:33.887ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21902024-12-18T19:49:33.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21912024-12-18T19:49:34.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115223 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54990 req_id = 1a9991f7-29bb-4dee-94b9-509b7909fce7 response_code = 204 uri = /switch-ports
21922024-12-18T19:49:34.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54990 req_id = 33d37f7d-f473-475c-942a-afb3b98a5bab response_code = 200 uri = /network-bootstore-config
21932024-12-18T19:49:34.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61791
21942024-12-18T19:49:34.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61791 req_id = 9e6f6618-289a-4959-8f9f-3d5469d56159 response_code = 200 uri = /vpc-routes
21952024-12-18T19:49:34.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61393
21962024-12-18T19:49:34.108ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21972024-12-18T19:49:34.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21982024-12-18T19:49:34.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61393 req_id = 24067106-97ba-4ad8-add5-4e86e2340be2 response_code = 204 uri = /switch-ports
21992024-12-18T19:49:34.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22002024-12-18T19:49:34.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61791 req_id = fe855419-ed87-4d21-b8dc-b90d6c182c3e response_code = 204 uri = /eip-gateways
22012024-12-18T19:49:34.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61393 req_id = 25ea7769-6911-4097-864b-915ec3f44805 response_code = 200 uri = /network-bootstore-config
22022024-12-18T19:49:34.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41130
22032024-12-18T19:49:34.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41130 req_id = f34190ca-6716-46f6-b546-12740ef51c5d response_code = 200 uri = /v2p
22042024-12-18T19:49:34.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61791 req_id = 1a8b507a-8be3-48c8-96b3-858fc69825d8 response_code = 204 uri = /vpc-routes
22052024-12-18T19:49:34.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62517
22062024-12-18T19:49:34.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22072024-12-18T19:49:34.298ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22082024-12-18T19:49:34.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96170 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62517 req_id = 0e50724e-1831-4b37-aa4b-d52dea02b495 response_code = 204 uri = /switch-ports
22092024-12-18T19:49:34.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62517 req_id = 5c432842-6953-4b02-bc21-d7901773e0df response_code = 200 uri = /network-bootstore-config
22102024-12-18T19:49:56.932ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42944
22112024-12-18T19:49:56.932ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42944 req_id = 2f9f97bd-4716-4fd0-b217-ef1cfa41e001 response_code = 200 uri = /baseboard
22122024-12-18T19:50:03.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38407
22132024-12-18T19:50:03.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 55a3f313-1424-4c9f-b847-d779326aaebd response_code = 200 uri = /vpc-routes
22142024-12-18T19:50:03.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63003
22152024-12-18T19:50:03.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63003 req_id = 3221f357-04ad-4ff5-b6a5-259fbb429f50 response_code = 200 uri = /v2p
22162024-12-18T19:50:03.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33879
22172024-12-18T19:50:03.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33879 req_id = 5f1e87f5-3990-40b7-a1c4-539104c52b5a response_code = 200 uri = /vpc-routes
22182024-12-18T19:50:03.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44977
22192024-12-18T19:50:03.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44977 req_id = 23357d46-fe1a-4ca1-9013-e4222116e9d9 response_code = 200 uri = /v2p
22202024-12-18T19:50:03.586ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22212024-12-18T19:50:03.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 35400ab4-8a5b-4c29-be40-9399fa62e4a0 response_code = 204 uri = /eip-gateways
22222024-12-18T19:50:03.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38407 req_id = 49376f53-c3dd-443b-b818-ea3208027a4d response_code = 204 uri = /vpc-routes
22232024-12-18T19:50:03.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40697
22242024-12-18T19:50:03.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22252024-12-18T19:50:03.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22262024-12-18T19:50:03.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111922 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40697 req_id = d0ad9012-4877-487f-a5e7-66f682739d2d response_code = 204 uri = /switch-ports
22272024-12-18T19:50:03.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45278
22282024-12-18T19:50:03.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22292024-12-18T19:50:03.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33879 req_id = b30fb770-9ee7-4f44-8c8d-b8d7b1e20db0 response_code = 204 uri = /eip-gateways
22302024-12-18T19:50:03.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22312024-12-18T19:50:03.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4791 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40697 req_id = 9bc89ab9-1587-41b0-802e-9b291926c9bd response_code = 200 uri = /network-bootstore-config
22322024-12-18T19:50:03.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33879 req_id = 94279d51-81c5-4581-884a-3dc688858833 response_code = 204 uri = /vpc-routes
22332024-12-18T19:50:03.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40539
22342024-12-18T19:50:03.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40539 req_id = b771b21a-f341-4ebd-b959-a4bfa715da82 response_code = 200 uri = /vpc-routes
22352024-12-18T19:50:03.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22362024-12-18T19:50:03.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45278 req_id = 5fbb26fc-8afb-4ded-91cc-2e9f13457de7 response_code = 204 uri = /switch-ports
22372024-12-18T19:50:03.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45278 req_id = a30b9bf0-24dc-490f-b9b8-92ae5a3b4613 response_code = 200 uri = /network-bootstore-config
22382024-12-18T19:50:03.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38004
22392024-12-18T19:50:03.922ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22402024-12-18T19:50:03.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22412024-12-18T19:50:04.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90155 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38004 req_id = f946e3d4-f2ac-44e8-95f5-85eb8c62689b response_code = 204 uri = /switch-ports
22422024-12-18T19:50:04.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36003
22432024-12-18T19:50:04.012ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22442024-12-18T19:50:04.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40539 req_id = 329d4182-fb76-49e8-aa9c-91eac5e9d7ff response_code = 204 uri = /eip-gateways
22452024-12-18T19:50:04.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38004 req_id = dafc06d7-63b7-414b-a873-3f6cf6d31b8c response_code = 200 uri = /network-bootstore-config
22462024-12-18T19:50:04.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36003 req_id = 0ec15966-4b6b-4267-ae0f-4d936060188b response_code = 200 uri = /v2p
22472024-12-18T19:50:04.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40539 req_id = 593936a9-eb83-40aa-86b0-d4ad96ba6e5b response_code = 204 uri = /vpc-routes
22482024-12-18T19:50:26.964ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47671
22492024-12-18T19:50:26.964ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47671 req_id = 331a4365-140d-4f95-9d60-c181cb0c068b response_code = 200 uri = /baseboard
22502024-12-18T19:50:33.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58865
22512024-12-18T19:50:33.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58865 req_id = 0b38171d-5f2a-49ab-ac82-f31bdce2011d response_code = 200 uri = /vpc-routes
22522024-12-18T19:50:33.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62272
22532024-12-18T19:50:33.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62272 req_id = 98e42d9e-647f-4406-9a99-6cc511061241 response_code = 200 uri = /v2p
22542024-12-18T19:50:33.750ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22552024-12-18T19:50:33.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58865 req_id = e322daf5-180e-4b2a-968a-d29c8f217d45 response_code = 204 uri = /eip-gateways
22562024-12-18T19:50:33.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58865 req_id = fb262a50-f390-46f6-933e-74f9a843bca1 response_code = 204 uri = /vpc-routes
22572024-12-18T19:50:33.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49734
22582024-12-18T19:50:33.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49734 req_id = 68ee5c1b-b513-49e2-8dc4-9a0db163723d response_code = 200 uri = /vpc-routes
22592024-12-18T19:50:33.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38415
22602024-12-18T19:50:33.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22612024-12-18T19:50:33.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22622024-12-18T19:50:33.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38415 req_id = 86253f4c-1d28-45e7-b62a-2de64eb5906d response_code = 204 uri = /switch-ports
22632024-12-18T19:50:33.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39742
22642024-12-18T19:50:33.893ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22652024-12-18T19:50:33.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49734 req_id = 695d678b-1f11-4e53-906d-d00cb7d73e2a response_code = 204 uri = /eip-gateways
22662024-12-18T19:50:33.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38415 req_id = fa7d6dee-bc33-41db-a3e3-83c2e9d360de response_code = 200 uri = /network-bootstore-config
22672024-12-18T19:50:33.893ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22682024-12-18T19:50:33.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49734 req_id = 8d847b5a-941d-4760-a35a-a9e8682bc7cd response_code = 204 uri = /vpc-routes
22692024-12-18T19:50:33.937ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22702024-12-18T19:50:33.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47755
22712024-12-18T19:50:33.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47755 req_id = c17b7a47-ca6d-4283-8965-23f32adb35a5 response_code = 200 uri = /vpc-routes
22722024-12-18T19:50:34.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131838 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39742 req_id = 893117d2-f092-4cc4-83ee-92737c3a2a21 response_code = 204 uri = /switch-ports
22732024-12-18T19:50:34.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39742 req_id = 9e395858-6a97-4746-8bfa-1e88437b4a77 response_code = 200 uri = /network-bootstore-config
22742024-12-18T19:50:34.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22752024-12-18T19:50:34.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47755 req_id = 26cc997f-dfb5-41da-adc0-b85d6537c0a1 response_code = 204 uri = /eip-gateways
22762024-12-18T19:50:34.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47755 req_id = 838fb565-180a-4233-b882-b73510a25f1d response_code = 204 uri = /vpc-routes
22772024-12-18T19:50:34.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35826
22782024-12-18T19:50:34.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22792024-12-18T19:50:34.192ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22802024-12-18T19:50:34.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35826 req_id = 9bac11b5-a6b0-4492-a75f-08af20d194aa response_code = 204 uri = /switch-ports
22812024-12-18T19:50:34.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59720
22822024-12-18T19:50:34.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59720 req_id = 332fe002-72cc-4424-aadb-f8daa3e2303e response_code = 200 uri = /v2p
22832024-12-18T19:50:34.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35826 req_id = 7d3ab724-6544-4db1-8265-27d9d4eac362 response_code = 200 uri = /network-bootstore-config
22842024-12-18T19:50:34.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58369
22852024-12-18T19:50:34.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58369 req_id = 91403b28-2bc7-45b2-b916-55b508afef3e response_code = 200 uri = /v2p
22862024-12-18T19:50:44.542ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:64949 remote_addr = [fd00:1122:3344:101::d]:34806 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
22872024-12-18T19:50:44.589ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44862 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = f476b282-272f-45b7-a6f4-ea0e95ad5a1f response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
22882024-12-18T19:50:57.000ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35981
22892024-12-18T19:50:57.000ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35981 req_id = b3eb689a-cdb8-4ebe-a58c-02f4be34c0d2 response_code = 200 uri = /baseboard
22902024-12-18T19:51:03.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60837
22912024-12-18T19:51:03.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60837 req_id = f73b5cde-67c9-42f2-8c90-9acdd5e42bb4 response_code = 200 uri = /v2p
22922024-12-18T19:51:03.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38333
22932024-12-18T19:51:03.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38333 req_id = a6c43360-1a38-4f2a-b30d-101b45896bee response_code = 200 uri = /vpc-routes
22942024-12-18T19:51:03.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63441
22952024-12-18T19:51:03.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63441 req_id = 5198c42e-84b4-407f-96e8-ee5cb8b7b705 response_code = 200 uri = /vpc-routes
22962024-12-18T19:51:03.624ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22972024-12-18T19:51:03.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63441 req_id = c0665be0-4c3f-4844-9d83-c311d421e7fa response_code = 204 uri = /eip-gateways
22982024-12-18T19:51:03.655ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
22992024-12-18T19:51:03.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38333 req_id = 96c37f05-91b2-4a31-a26c-fbd48fbfd4cf response_code = 204 uri = /eip-gateways
23002024-12-18T19:51:03.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42153
23012024-12-18T19:51:03.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23022024-12-18T19:51:03.733ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23032024-12-18T19:51:03.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130763 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42153 req_id = 2498871d-47ff-4f7e-b235-81b6e5ee265b response_code = 204 uri = /switch-ports
23042024-12-18T19:51:03.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59872
23052024-12-18T19:51:03.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47350
23062024-12-18T19:51:03.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63441 req_id = 05d82977-d924-4374-97ad-35c0b3fc11e7 response_code = 204 uri = /vpc-routes
23072024-12-18T19:51:03.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42153 req_id = 52e1607b-18f7-4591-bac2-308bb626fd0e response_code = 200 uri = /network-bootstore-config
23082024-12-18T19:51:03.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38333 req_id = 6d8a9017-eb88-407f-9a40-cf99cdd590d8 response_code = 204 uri = /vpc-routes
23092024-12-18T19:51:03.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47350 req_id = 7fa78324-292c-4398-88b2-472228c97481 response_code = 200 uri = /v2p
23102024-12-18T19:51:03.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23112024-12-18T19:51:03.856ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23122024-12-18T19:51:03.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36523
23132024-12-18T19:51:03.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36523 req_id = 51461587-7c6e-4349-b3b2-09484d80e487 response_code = 200 uri = /vpc-routes
23142024-12-18T19:51:03.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59872 req_id = 1ba4415a-ae65-4c6d-98d2-2d0d1078d6c1 response_code = 204 uri = /switch-ports
23152024-12-18T19:51:03.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59872 req_id = 53053c1c-866d-42bb-8df3-54b0248543e5 response_code = 200 uri = /network-bootstore-config
23162024-12-18T19:51:03.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39701
23172024-12-18T19:51:03.977ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23182024-12-18T19:51:04.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23192024-12-18T19:51:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93042 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39701 req_id = e162bea6-812b-4422-8cab-d1d79cddcffc response_code = 204 uri = /switch-ports
23202024-12-18T19:51:04.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47328
23212024-12-18T19:51:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47328 req_id = fda2692f-b871-40ee-b16c-944e1cac6f85 response_code = 200 uri = /v2p
23222024-12-18T19:51:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39701 req_id = ef520b0e-763f-45f6-9b90-48255e23755d response_code = 200 uri = /network-bootstore-config
23232024-12-18T19:51:04.075ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23242024-12-18T19:51:04.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36523 req_id = 6a76bb7b-f6d2-42b0-964b-a82d132bb008 response_code = 204 uri = /eip-gateways
23252024-12-18T19:51:04.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36523 req_id = e81945ab-e3ba-41e1-ad6c-ce9bc7a2654b response_code = 204 uri = /vpc-routes
23262024-12-18T19:51:14.548ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6355 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = a71663cb-4951-4150-a7e2-6b8140696728 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
23272024-12-18T19:51:27.036ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51621
23282024-12-18T19:51:27.036ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51621 req_id = 642396fd-52bc-4346-9beb-d71c48201224 response_code = 200 uri = /baseboard
23292024-12-18T19:51:33.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34336
23302024-12-18T19:51:33.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34336 req_id = 71a4d256-8ada-4966-8694-7e2b20538006 response_code = 200 uri = /vpc-routes
23312024-12-18T19:51:33.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44472
23322024-12-18T19:51:33.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44472 req_id = 2fe92448-1387-4843-b0fe-47b5befd34e1 response_code = 200 uri = /vpc-routes
23332024-12-18T19:51:33.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23342024-12-18T19:51:33.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34336 req_id = 6c112021-7314-40bb-ac20-c83835e62c73 response_code = 204 uri = /eip-gateways
23352024-12-18T19:51:33.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60937
23362024-12-18T19:51:33.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60937 req_id = de6475a7-d288-4b6f-b647-1829681da8f0 response_code = 200 uri = /v2p
23372024-12-18T19:51:33.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34336 req_id = a4a2bd12-b4db-48e6-b617-a0b60fdab90f response_code = 204 uri = /vpc-routes
23382024-12-18T19:51:33.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36848
23392024-12-18T19:51:33.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23402024-12-18T19:51:33.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23412024-12-18T19:51:34.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142544 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36848 req_id = 88afb4fe-037e-4c47-acf0-5c1eb14f92f3 response_code = 204 uri = /switch-ports
23422024-12-18T19:51:34.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58914
23432024-12-18T19:51:34.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23442024-12-18T19:51:34.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44472 req_id = e41a4fb6-7011-451e-afcc-f97fc8d565cd response_code = 204 uri = /eip-gateways
23452024-12-18T19:51:34.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36848 req_id = ecf27ab2-9974-45ea-9d3c-921e6a50d96a response_code = 200 uri = /network-bootstore-config
23462024-12-18T19:51:34.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23472024-12-18T19:51:34.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23482024-12-18T19:51:34.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63406
23492024-12-18T19:51:34.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63406 req_id = 3b9c7e8f-f6ed-4302-aca6-853e7e8cd7d7 response_code = 200 uri = /v2p
23502024-12-18T19:51:34.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58914 req_id = 154f20dc-f0e4-46a6-8598-9c3c7638414c response_code = 204 uri = /switch-ports
23512024-12-18T19:51:34.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58914 req_id = f9a72239-1e3a-439b-9671-686d9f5aaa5d response_code = 200 uri = /network-bootstore-config
23522024-12-18T19:51:34.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58669
23532024-12-18T19:51:34.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58669 req_id = 2f81057a-4396-48d3-be9a-5a489ea23efe response_code = 200 uri = /vpc-routes
23542024-12-18T19:51:34.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44472 req_id = 1641531c-b594-41de-9d90-3e32a9ee67e6 response_code = 204 uri = /vpc-routes
23552024-12-18T19:51:34.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23562024-12-18T19:51:34.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58669 req_id = 82490b4f-2b02-4bf8-bc67-9eed784aa94e response_code = 204 uri = /eip-gateways
23572024-12-18T19:51:34.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62493
23582024-12-18T19:51:34.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23592024-12-18T19:51:34.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23602024-12-18T19:51:34.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98880 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62493 req_id = 1595af47-6a79-4aac-a004-4d7c6edd496d response_code = 204 uri = /switch-ports
23612024-12-18T19:51:34.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58669 req_id = 029eb4d8-1c70-4e5c-aef9-d685d8f32b23 response_code = 204 uri = /vpc-routes
23622024-12-18T19:51:34.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62493 req_id = d9cce484-4067-4aba-9f28-ea8ca4c022b0 response_code = 200 uri = /network-bootstore-config
23632024-12-18T19:51:34.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50999
23642024-12-18T19:51:34.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50999 req_id = ec757ffa-d680-4d8e-bde6-9e32b8637535 response_code = 200 uri = /v2p
23652024-12-18T19:51:44.548ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6467 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 1fb9261f-8ef6-4ce3-8da0-fe0eb920b2af response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
23662024-12-18T19:51:57.070ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63500
23672024-12-18T19:51:57.070ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63500 req_id = f637db26-7d77-4091-a1cc-53d36cd1226b response_code = 200 uri = /baseboard
23682024-12-18T19:52:03.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46553
23692024-12-18T19:52:03.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46553 req_id = 2d342da2-d62e-40f0-a768-2de202e0d80e response_code = 200 uri = /vpc-routes
23702024-12-18T19:52:03.545ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23712024-12-18T19:52:03.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46553 req_id = 17fe2616-87cb-4c79-9f01-1852aadfb379 response_code = 204 uri = /eip-gateways
23722024-12-18T19:52:03.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46553 req_id = 1afdfebf-0f1d-44f6-ba6d-208f11f4b143 response_code = 204 uri = /vpc-routes
23732024-12-18T19:52:03.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43136
23742024-12-18T19:52:03.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43136 req_id = 9e1e5b4b-90b2-4368-8fe0-dedfba10a747 response_code = 200 uri = /vpc-routes
23752024-12-18T19:52:03.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63171
23762024-12-18T19:52:03.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63171 req_id = 6a08af4e-8f4e-4e1c-81e4-159ccb908bd7 response_code = 200 uri = /v2p
23772024-12-18T19:52:03.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23782024-12-18T19:52:03.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43136 req_id = 2b1f19d9-dce0-4495-ac96-3502bacc1ce5 response_code = 204 uri = /eip-gateways
23792024-12-18T19:52:03.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51274
23802024-12-18T19:52:03.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23812024-12-18T19:52:03.852ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23822024-12-18T19:52:03.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111645 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51274 req_id = 74de8929-06a1-43ca-9e42-7ee3be037768 response_code = 204 uri = /switch-ports
23832024-12-18T19:52:03.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34941
23842024-12-18T19:52:03.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44047
23852024-12-18T19:52:03.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40841
23862024-12-18T19:52:03.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51274 req_id = 98e4b52a-e636-4f2f-9433-d9680d4f4b44 response_code = 200 uri = /network-bootstore-config
23872024-12-18T19:52:03.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43136 req_id = bbdbb36f-7f28-42bd-a6c7-9ff308fa4c31 response_code = 204 uri = /vpc-routes
23882024-12-18T19:52:03.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44047 req_id = 727a6a52-3122-41ac-b2ec-9a8043f40ce4 response_code = 200 uri = /vpc-routes
23892024-12-18T19:52:03.926ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23902024-12-18T19:52:03.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34941 req_id = 168198de-9251-4c49-a608-262f7185644e response_code = 200 uri = /v2p
23912024-12-18T19:52:03.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38952
23922024-12-18T19:52:03.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
23932024-12-18T19:52:03.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44047 req_id = 0a4921f3-ac02-468d-9730-f52fe21b3c35 response_code = 204 uri = /eip-gateways
23942024-12-18T19:52:03.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44047 req_id = a40c463d-fcba-4578-b6ce-2fbbcb8af42f response_code = 204 uri = /vpc-routes
23952024-12-18T19:52:03.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23962024-12-18T19:52:04.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48480
23972024-12-18T19:52:04.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48480 req_id = 1ca46023-b941-411a-955e-0871cae27618 response_code = 200 uri = /v2p
23982024-12-18T19:52:04.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23992024-12-18T19:52:04.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40841 req_id = 8b23d07c-6728-467b-b4c6-d13e5799af7d response_code = 204 uri = /switch-ports
24002024-12-18T19:52:04.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40841 req_id = e8f9abf2-9c06-47d4-b890-f9f82196b276 response_code = 200 uri = /network-bootstore-config
24012024-12-18T19:52:04.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24022024-12-18T19:52:04.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38952 req_id = b0ab2ed8-bc7c-4b32-8ea3-3e88b972f992 response_code = 204 uri = /switch-ports
24032024-12-18T19:52:04.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38952 req_id = 5acd8302-0d11-49e9-955e-7e622108f3fe response_code = 200 uri = /network-bootstore-config
24042024-12-18T19:52:14.548ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6611 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = ba0c1848-dae2-4f0c-8f18-4426a918765b response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
24052024-12-18T19:52:27.105ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33314
24062024-12-18T19:52:27.105ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33314 req_id = ee9cc2c4-8d56-4e37-a0d1-30808a27ee25 response_code = 200 uri = /baseboard
24072024-12-18T19:52:33.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57716
24082024-12-18T19:52:33.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57716 req_id = f0b4f422-9861-4d60-8cae-1ccafc1642ee response_code = 200 uri = /vpc-routes
24092024-12-18T19:52:33.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61596
24102024-12-18T19:52:33.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61596 req_id = 28cb8f5c-e808-4966-88e3-58b845af69f8 response_code = 200 uri = /vpc-routes
24112024-12-18T19:52:33.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24122024-12-18T19:52:33.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61596 req_id = 3d423a1a-3719-4e90-8c4a-ce56e62f9fcb response_code = 204 uri = /eip-gateways
24132024-12-18T19:52:33.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61596 req_id = 385fc900-0d4a-4671-8c71-4f22d29b614c response_code = 204 uri = /vpc-routes
24142024-12-18T19:52:33.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58166
24152024-12-18T19:52:33.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58166 req_id = e22c785e-d2fd-4185-9cc9-3010d3464f14 response_code = 200 uri = /vpc-routes
24162024-12-18T19:52:34.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41319
24172024-12-18T19:52:34.009ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24182024-12-18T19:52:34.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24192024-12-18T19:52:34.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118168 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41319 req_id = b6097b4f-d2ea-4a14-8513-c0da1799f3a0 response_code = 204 uri = /switch-ports
24202024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53812
24212024-12-18T19:52:34.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24222024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57716 req_id = 174d6d30-29b9-47f7-93cb-9607a570f91b response_code = 204 uri = /eip-gateways
24232024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32796
24242024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45153
24252024-12-18T19:52:34.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24262024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58166 req_id = 30243295-460b-4ad1-bfe2-136ec3b4af92 response_code = 204 uri = /eip-gateways
24272024-12-18T19:52:34.128ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24282024-12-18T19:52:34.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41319 req_id = c538e21a-88e6-46c0-913c-82fb58f61486 response_code = 200 uri = /network-bootstore-config
24292024-12-18T19:52:34.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5496 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45153 req_id = b7d5636c-9172-42bf-a71d-e26d1bfc3cc2 response_code = 200 uri = /v2p
24302024-12-18T19:52:34.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37110
24312024-12-18T19:52:34.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37110 req_id = dd881be5-7548-4704-ae35-7ecbdab29c95 response_code = 200 uri = /v2p
24322024-12-18T19:52:34.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58166 req_id = 60992f2f-7d9e-4741-99ff-50941fbe840f response_code = 204 uri = /vpc-routes
24332024-12-18T19:52:34.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57716 req_id = 2d9b6851-2e78-4540-bb4c-912d967631a4 response_code = 204 uri = /vpc-routes
24342024-12-18T19:52:34.171ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24352024-12-18T19:52:34.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24362024-12-18T19:52:34.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53812 req_id = 7093142f-3a93-42ce-afdb-3e5393fb0a8e response_code = 204 uri = /switch-ports
24372024-12-18T19:52:34.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53812 req_id = 79d070ec-71cb-4c80-9715-4da7a1f74090 response_code = 200 uri = /network-bootstore-config
24382024-12-18T19:52:34.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40469
24392024-12-18T19:52:34.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40469 req_id = 2db3b88a-a079-40cc-862e-000e3cfe4122 response_code = 200 uri = /v2p
24402024-12-18T19:52:34.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24412024-12-18T19:52:34.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32796 req_id = aacf87bc-6930-48a7-aee7-fc960d79cdcf response_code = 204 uri = /switch-ports
24422024-12-18T19:52:34.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32796 req_id = 597c4dcd-170f-4c57-856d-e6f49ec698cf response_code = 200 uri = /network-bootstore-config
24432024-12-18T19:52:44.560ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18552 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 2a4acd88-2032-4da5-93d8-a0d4aed9e93c response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
24442024-12-18T19:52:57.386ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33570
24452024-12-18T19:52:57.386ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33570 req_id = dea1047f-5f6c-47a9-94a3-aa63ee704b81 response_code = 200 uri = /baseboard
24462024-12-18T19:53:03.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61934
24472024-12-18T19:53:03.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61934 req_id = 203be880-8605-49f0-89f7-3fe6361c3c68 response_code = 200 uri = /vpc-routes
24482024-12-18T19:53:03.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59564
24492024-12-18T19:53:03.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59564 req_id = c4f1b697-f516-46bd-8c59-cf49daac91ce response_code = 200 uri = /vpc-routes
24502024-12-18T19:53:03.625ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24512024-12-18T19:53:03.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61934 req_id = 3c534897-5365-4daf-9fcb-aaef1e0f9d62 response_code = 204 uri = /eip-gateways
24522024-12-18T19:53:03.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61934 req_id = 03f3a279-d58f-4712-ad41-2e92c409bc3c response_code = 204 uri = /vpc-routes
24532024-12-18T19:53:03.648ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24542024-12-18T19:53:03.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59564 req_id = 2909a853-bca1-4c2f-b397-560af9a5f181 response_code = 204 uri = /eip-gateways
24552024-12-18T19:53:03.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63926
24562024-12-18T19:53:03.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63926 req_id = ffe37986-60d0-498b-9043-058ddf2271ec response_code = 200 uri = /v2p
24572024-12-18T19:53:03.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59564 req_id = ac5431b8-bf69-4e84-addc-b747e21ded48 response_code = 204 uri = /vpc-routes
24582024-12-18T19:53:03.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54417
24592024-12-18T19:53:03.741ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24602024-12-18T19:53:03.792ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24612024-12-18T19:53:03.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120379 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54417 req_id = b73458f4-ed94-46ac-8c99-fe822b17fd34 response_code = 204 uri = /switch-ports
24622024-12-18T19:53:03.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62956
24632024-12-18T19:53:03.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49570
24642024-12-18T19:53:03.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33768
24652024-12-18T19:53:03.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33768 req_id = 5310b861-62eb-42c4-a6fa-16448e9ec2c9 response_code = 200 uri = /vpc-routes
24662024-12-18T19:53:03.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24672024-12-18T19:53:03.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54417 req_id = 512cf3da-9fb6-45d0-b98d-c299503535b2 response_code = 200 uri = /network-bootstore-config
24682024-12-18T19:53:03.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5451 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49570 req_id = e5e5e98f-c2e4-4c96-b43c-0609ba859ea6 response_code = 200 uri = /v2p
24692024-12-18T19:53:03.882ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24702024-12-18T19:53:03.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5076 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33768 req_id = fd528b48-893d-418f-9f83-ec45b573f3d2 response_code = 204 uri = /eip-gateways
24712024-12-18T19:53:03.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1076 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33768 req_id = bc1b1a75-b984-4d86-a8c7-b6e5216db6fc response_code = 204 uri = /vpc-routes
24722024-12-18T19:53:03.906ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24732024-12-18T19:53:03.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46947
24742024-12-18T19:53:03.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24752024-12-18T19:53:03.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62956 req_id = 2b929c9e-fb41-4b28-9b05-1ad289a7cf26 response_code = 204 uri = /switch-ports
24762024-12-18T19:53:03.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 734 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62956 req_id = f7e4627f-96d5-4a24-9464-62c420eb681a response_code = 200 uri = /network-bootstore-config
24772024-12-18T19:53:03.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38310
24782024-12-18T19:53:03.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38310 req_id = 58a09c55-2c54-4afc-99af-df87936068bb response_code = 200 uri = /v2p
24792024-12-18T19:53:04.008ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24802024-12-18T19:53:04.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147761 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46947 req_id = 2c7be80c-d852-49dc-ad75-8bc380772cdc response_code = 204 uri = /switch-ports
24812024-12-18T19:53:04.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46947 req_id = 15faa810-8c9e-49ad-bcd9-17e39a59a90b response_code = 200 uri = /network-bootstore-config
24822024-12-18T19:53:14.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7442 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = b2715399-1336-44d3-b7a7-22da0bd75b2a response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
24832024-12-18T19:53:27.420ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65064
24842024-12-18T19:53:27.420ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65064 req_id = 9b3f79d7-94c5-4e9c-935d-60fa7ea0133b response_code = 200 uri = /baseboard
24852024-12-18T19:53:33.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57149
24862024-12-18T19:53:33.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57149 req_id = 4d536043-6705-4252-bc25-2f9c175070d0 response_code = 200 uri = /vpc-routes
24872024-12-18T19:53:33.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
24882024-12-18T19:53:33.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57149 req_id = 6fee7f56-21aa-4c66-a5e0-dabe17d90daf response_code = 204 uri = /eip-gateways
24892024-12-18T19:53:33.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61781
24902024-12-18T19:53:33.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61781 req_id = d997ff03-1e1e-4d5b-b7c6-2475d3863e80 response_code = 200 uri = /v2p
24912024-12-18T19:53:33.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57149 req_id = 41b312fe-b52a-4643-9efc-52ab191f5420 response_code = 204 uri = /vpc-routes
24922024-12-18T19:53:33.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56668
24932024-12-18T19:53:33.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56668 req_id = ec58df24-bc6f-4a07-acee-247e0f99cd3b response_code = 200 uri = /vpc-routes
24942024-12-18T19:53:33.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39925
24952024-12-18T19:53:33.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24962024-12-18T19:53:33.902ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24972024-12-18T19:53:33.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39925 req_id = d0472ed4-b2ac-42b1-9f07-aaddc7f82671 response_code = 204 uri = /switch-ports
24982024-12-18T19:53:33.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49510
24992024-12-18T19:53:33.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40727
25002024-12-18T19:53:33.985ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25012024-12-18T19:53:33.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56668 req_id = 5e0b8d44-78e6-4b4e-8433-1e672c8cd6ee response_code = 204 uri = /eip-gateways
25022024-12-18T19:53:33.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39925 req_id = 202f32f6-6499-4536-b486-0bac3ad3705c response_code = 200 uri = /network-bootstore-config
25032024-12-18T19:53:33.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49510 req_id = 14af6329-6775-4943-a59f-ecbbd76e5434 response_code = 200 uri = /v2p
25042024-12-18T19:53:33.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40727 req_id = 2e14376a-7a48-4b27-9e07-c333d13113f7 response_code = 200 uri = /vpc-routes
25052024-12-18T19:53:33.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 412 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56668 req_id = e85a1e42-1ebc-4ea9-af39-7e02b1b40948 response_code = 204 uri = /vpc-routes
25062024-12-18T19:53:34.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25072024-12-18T19:53:34.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40727 req_id = 6254e7d3-519d-494d-a5bd-c51ecbb926a7 response_code = 204 uri = /eip-gateways
25082024-12-18T19:53:34.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40727 req_id = ea0ac380-c7e4-4a3e-97cd-2f9daa690e4b response_code = 204 uri = /vpc-routes
25092024-12-18T19:53:34.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60028
25102024-12-18T19:53:34.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25112024-12-18T19:53:34.133ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25122024-12-18T19:53:34.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117045 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60028 req_id = afedccfc-092f-4be9-9ae0-58b1ec3d86ea response_code = 204 uri = /switch-ports
25132024-12-18T19:53:34.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35437
25142024-12-18T19:53:34.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41102
25152024-12-18T19:53:34.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60028 req_id = 0a3e3f7b-daa4-40f7-a12f-981c27e4b08d response_code = 200 uri = /network-bootstore-config
25162024-12-18T19:53:34.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25172024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25182024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25192024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25202024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25212024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25222024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25232024-12-18T19:53:34.208ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25242024-12-18T19:53:34.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41102 req_id = d1bfc9d6-ed2a-4001-bf41-a3476bfdb45a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25252024-12-18T19:53:34.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37836
25262024-12-18T19:53:34.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37836 req_id = 1c3fdbfd-fcde-47ba-a6d2-6d9fc3e4310b response_code = 200 uri = /v2p
25272024-12-18T19:53:34.247ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25282024-12-18T19:53:34.276ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44455
25292024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25302024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25312024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25322024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25332024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25342024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25352024-12-18T19:53:34.277ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25362024-12-18T19:53:34.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44455 req_id = d9574a9d-fb0b-4dca-aeb9-f6743608795e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25372024-12-18T19:53:34.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35437 req_id = 033123fa-a3ce-4bb6-ae1e-3146959508f6 response_code = 204 uri = /switch-ports
25382024-12-18T19:53:34.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35437 req_id = d3c24412-9fb7-49b4-9e80-5fe88434f170 response_code = 200 uri = /network-bootstore-config
25392024-12-18T19:53:34.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63800
25402024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25412024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25422024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25432024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25442024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25452024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25462024-12-18T19:53:34.549ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25472024-12-18T19:53:34.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63800 req_id = de4180b5-a2de-4717-8b42-c4a9d91e9f67 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25482024-12-18T19:53:44.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7055 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 7d8faf57-edad-4373-8c08-0ec3a94200fe response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
25492024-12-18T19:53:57.453ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58321
25502024-12-18T19:53:57.453ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58321 req_id = 73044b25-94c1-48f3-99fd-2434ae2c6979 response_code = 200 uri = /baseboard
25512024-12-18T19:54:03.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53783
25522024-12-18T19:54:03.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53783 req_id = 41b473e6-053b-49ce-ae5b-54c3599b8049 response_code = 200 uri = /vpc-routes
25532024-12-18T19:54:03.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42061
25542024-12-18T19:54:03.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42061 req_id = f9a3322c-c8be-422e-912a-20e61f7f71a8 response_code = 200 uri = /vpc-routes
25552024-12-18T19:54:03.654ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25562024-12-18T19:54:03.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53783 req_id = 123588ea-4639-4448-ad04-883a1f5766fd response_code = 204 uri = /eip-gateways
25572024-12-18T19:54:03.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53783 req_id = 3fc8bd0d-b69d-4d9b-8a2b-da07821a9abe response_code = 204 uri = /vpc-routes
25582024-12-18T19:54:03.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53948
25592024-12-18T19:54:03.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25602024-12-18T19:54:03.732ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25612024-12-18T19:54:03.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126397 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53948 req_id = 86cd1e2f-92b4-4a4b-a232-d3163b5b7820 response_code = 204 uri = /switch-ports
25622024-12-18T19:54:03.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52143
25632024-12-18T19:54:03.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25642024-12-18T19:54:03.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42061 req_id = 6db547e7-cf2c-4ce6-b21e-1963c597be2b response_code = 204 uri = /eip-gateways
25652024-12-18T19:54:03.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60618
25662024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38044
25672024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62962
25682024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52143 req_id = 738023e5-30f3-4515-bc43-5fe15678eb28 response_code = 200 uri = /v2p
25692024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53948 req_id = a1033c08-6449-492c-b636-6d373b04c24e response_code = 200 uri = /network-bootstore-config
25702024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62962 req_id = 26e90bac-d92b-4176-a8e3-4ab456d5494a response_code = 200 uri = /vpc-routes
25712024-12-18T19:54:03.808ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25722024-12-18T19:54:03.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38044 req_id = bd8c466c-1a79-4d69-86c5-08cd7f7ce51d response_code = 200 uri = /v2p
25732024-12-18T19:54:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 445 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42061 req_id = 3ac3423a-3d3a-470d-87cc-080c910cb2c9 response_code = 204 uri = /vpc-routes
25742024-12-18T19:54:03.854ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25752024-12-18T19:54:03.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25762024-12-18T19:54:03.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62962 req_id = 54080b69-bd01-41cb-8916-61c9c6789948 response_code = 204 uri = /eip-gateways
25772024-12-18T19:54:03.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62962 req_id = 2e1db17b-8292-4974-b442-80d08268de9a response_code = 204 uri = /vpc-routes
25782024-12-18T19:54:03.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49862
25792024-12-18T19:54:03.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25802024-12-18T19:54:03.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108503 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60618 req_id = dc68cb0e-4cef-4c4f-9545-f125687e5788 response_code = 204 uri = /switch-ports
25812024-12-18T19:54:03.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60618 req_id = b8421730-2375-4401-8ddc-3131140f5fb1 response_code = 200 uri = /network-bootstore-config
25822024-12-18T19:54:03.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25832024-12-18T19:54:04.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107722 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49862 req_id = b6a371b5-325a-46bd-a6d2-4bfc97fed4ff response_code = 204 uri = /switch-ports
25842024-12-18T19:54:04.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49862 req_id = f7ce1e5d-ffed-4f2a-816f-9b0e017c8379 response_code = 200 uri = /network-bootstore-config
25852024-12-18T19:54:04.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54157
25862024-12-18T19:54:04.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54157 req_id = 4296a747-6906-4083-8342-b978fd7eb4c3 response_code = 200 uri = /v2p
25872024-12-18T19:54:14.550ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7774 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 2fd35aa5-1a12-4d6a-90f9-10cb217c771a response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
25882024-12-18T19:54:19.627ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25892024-12-18T19:54:19.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25902024-12-18T19:54:19.658ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1934, tv_nsec: 946824774 } time_to_next_cleanup = 599.99999541s
25912024-12-18T19:54:27.488ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62452
25922024-12-18T19:54:27.488ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62452 req_id = 21a99096-adc6-43e3-a224-0664f4e2096a response_code = 200 uri = /baseboard
25932024-12-18T19:54:33.503ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
25942024-12-18T19:54:33.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63392
25952024-12-18T19:54:33.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63392 req_id = a2fa34ef-00a1-47a5-8f8c-c8eaec6883a9 response_code = 200 uri = /vpc-routes
25962024-12-18T19:54:33.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56870
25972024-12-18T19:54:33.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56870 req_id = 6f4537ef-b65f-4de6-95de-465da89aae0d response_code = 200 uri = /vpc-routes
25982024-12-18T19:54:33.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
25992024-12-18T19:54:33.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63392 req_id = 53dd3244-6364-403f-995e-822550ab2d83 response_code = 204 uri = /eip-gateways
26002024-12-18T19:54:33.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63392 req_id = 455aaeb3-2e64-4d58-a5b6-016f22a94c0a response_code = 204 uri = /vpc-routes
26012024-12-18T19:54:33.828ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26022024-12-18T19:54:33.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56870 req_id = 3802e7be-bc40-47d4-aa9d-84cbe69d7ab4 response_code = 204 uri = /eip-gateways
26032024-12-18T19:54:33.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63054
26042024-12-18T19:54:33.830ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26052024-12-18T19:54:33.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26062024-12-18T19:54:33.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128589 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63054 req_id = adc47dbe-9abc-4b6e-b336-99abbf92e002 response_code = 204 uri = /switch-ports
26072024-12-18T19:54:33.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54043
26082024-12-18T19:54:33.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56870 req_id = 302018e8-064a-40b6-b7d9-0b399e18f403 response_code = 204 uri = /vpc-routes
26092024-12-18T19:54:33.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63054 req_id = fd6a3f55-93bc-4dfd-bb86-075d753ecbc7 response_code = 200 uri = /network-bootstore-config
26102024-12-18T19:54:33.959ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26112024-12-18T19:54:33.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59619
26122024-12-18T19:54:33.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59619 req_id = 5bfa637c-7b41-4c18-9629-10b839a4ddb9 response_code = 200 uri = /v2p
26132024-12-18T19:54:33.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35314
26142024-12-18T19:54:33.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35314 req_id = 0b1a90ec-ca64-43ee-959e-c69b60e7e4c8 response_code = 200 uri = /v2p
26152024-12-18T19:54:34.004ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26162024-12-18T19:54:34.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104103 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54043 req_id = 902264db-fc43-4bb3-b3d4-da183af12b64 response_code = 204 uri = /switch-ports
26172024-12-18T19:54:34.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54043 req_id = 02b4e4df-b098-489a-b1e6-91408b76d957 response_code = 200 uri = /network-bootstore-config
26182024-12-18T19:54:34.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39892
26192024-12-18T19:54:34.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39892 req_id = 8be3eb0f-f4b7-4b5e-a7e9-2aa82875d09d response_code = 200 uri = /vpc-routes
26202024-12-18T19:54:34.148ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26212024-12-18T19:54:34.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39892 req_id = bc2cc607-7296-4875-b9e7-51bc276371de response_code = 204 uri = /eip-gateways
26222024-12-18T19:54:34.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49621
26232024-12-18T19:54:34.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49621 req_id = 34c0442d-38dd-4863-b437-93df5427611b response_code = 200 uri = /v2p
26242024-12-18T19:54:34.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48256
26252024-12-18T19:54:34.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26262024-12-18T19:54:34.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26272024-12-18T19:54:34.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48256 req_id = 263d76b9-f9f6-4132-aa50-fc6e51a9a3be response_code = 204 uri = /switch-ports
26282024-12-18T19:54:34.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39892 req_id = f773fa18-7ea6-4ca9-97e3-4f1b271ed491 response_code = 204 uri = /vpc-routes
26292024-12-18T19:54:34.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48256 req_id = 65679f1d-ff0b-45e0-ba52-60643756c8cb response_code = 200 uri = /network-bootstore-config
26302024-12-18T19:54:44.550ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8231 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = ad6268d1-f426-4566-9f51-8c624dbaff3f response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
26312024-12-18T19:54:57.523ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52186
26322024-12-18T19:54:57.523ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52186 req_id = 9c370279-64b2-45dd-9d35-3bd001bdc3e8 response_code = 200 uri = /baseboard
26332024-12-18T19:55:03.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64965
26342024-12-18T19:55:03.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64965 req_id = ea9c856f-537b-4802-aca2-5a973378d988 response_code = 200 uri = /vpc-routes
26352024-12-18T19:55:03.533ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26362024-12-18T19:55:03.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64965 req_id = b2ebbbde-b58f-41c5-a137-113e3533c75a response_code = 204 uri = /eip-gateways
26372024-12-18T19:55:03.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64965 req_id = 38e695cd-128a-4b67-9938-59582c5001fc response_code = 204 uri = /vpc-routes
26382024-12-18T19:55:03.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39526
26392024-12-18T19:55:03.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26402024-12-18T19:55:03.617ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26412024-12-18T19:55:03.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39526 req_id = e8c46d52-98e6-425b-8f9c-75ae46cdd41b response_code = 204 uri = /switch-ports
26422024-12-18T19:55:03.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53974
26432024-12-18T19:55:03.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55762
26442024-12-18T19:55:03.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57455
26452024-12-18T19:55:03.702ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26462024-12-18T19:55:03.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53974 req_id = e2fb1075-3d3f-4a60-a399-a6c652d75ba2 response_code = 200 uri = /vpc-routes
26472024-12-18T19:55:03.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39526 req_id = bb4f162a-be02-4c49-a076-e8a37fe38d9d response_code = 200 uri = /network-bootstore-config
26482024-12-18T19:55:03.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55762 req_id = c73aa0e4-ec96-4794-9c47-81c9bc921e1a response_code = 200 uri = /v2p
26492024-12-18T19:55:03.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46713
26502024-12-18T19:55:03.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46713 req_id = 9526b203-a725-4635-9f82-6d52331f50c5 response_code = 200 uri = /v2p
26512024-12-18T19:55:03.747ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26522024-12-18T19:55:03.765ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26532024-12-18T19:55:03.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53974 req_id = 5e17adee-f273-451c-a905-c48422b59caa response_code = 204 uri = /eip-gateways
26542024-12-18T19:55:03.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4550 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53974 req_id = ea52e512-5a7a-4575-afae-6931fb933071 response_code = 204 uri = /vpc-routes
26552024-12-18T19:55:03.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37252
26562024-12-18T19:55:03.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37252 req_id = 573d9166-0093-45f4-8207-0068168364e7 response_code = 200 uri = /vpc-routes
26572024-12-18T19:55:03.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113613 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57455 req_id = 4f771600-9ac8-4177-87b8-03b24d109a4f response_code = 204 uri = /switch-ports
26582024-12-18T19:55:03.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57455 req_id = 10d480b3-67d9-4eb3-af81-812d2fa7480f response_code = 200 uri = /network-bootstore-config
26592024-12-18T19:55:03.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46107
26602024-12-18T19:55:03.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46107 req_id = c6f3da8c-203d-469d-a266-f5fef83ca960 response_code = 200 uri = /v2p
26612024-12-18T19:55:03.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26622024-12-18T19:55:03.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37252 req_id = 46c9c4b3-73de-4ecc-8dcb-077cbfe7e4c1 response_code = 204 uri = /eip-gateways
26632024-12-18T19:55:03.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37252 req_id = 088e8fb4-c3ea-4b7e-b581-9f543aa4a3a6 response_code = 204 uri = /vpc-routes
26642024-12-18T19:55:03.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37383
26652024-12-18T19:55:03.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26662024-12-18T19:55:03.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26672024-12-18T19:55:03.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98073 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37383 req_id = 894e0e55-b0ad-4009-9a95-a158b2171cb6 response_code = 204 uri = /switch-ports
26682024-12-18T19:55:03.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37383 req_id = d2d8c5e8-e51f-4061-8f8a-f630b05519f4 response_code = 200 uri = /network-bootstore-config
26692024-12-18T19:55:14.548ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6708 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = fe3f5f92-62b5-4ae3-8dd2-84b98377b47b response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
26702024-12-18T19:55:27.555ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53167
26712024-12-18T19:55:27.556ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53167 req_id = 7ff99027-7ec2-4ff4-8666-4cea7a9c37d3 response_code = 200 uri = /baseboard
26722024-12-18T19:55:33.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45367
26732024-12-18T19:55:33.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45367 req_id = 4f957f38-93aa-4051-97db-9cf138624be0 response_code = 200 uri = /vpc-routes
26742024-12-18T19:55:33.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26752024-12-18T19:55:33.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45367 req_id = 277a0b10-6f71-4dfc-a0e8-a97eccde73e8 response_code = 204 uri = /eip-gateways
26762024-12-18T19:55:33.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45367 req_id = 1d455561-7220-492b-a43b-5552ac77f091 response_code = 204 uri = /vpc-routes
26772024-12-18T19:55:33.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50935
26782024-12-18T19:55:33.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50935 req_id = be0a4b81-39ea-46b8-adea-f2c5d166a02c response_code = 200 uri = /vpc-routes
26792024-12-18T19:55:33.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26802024-12-18T19:55:33.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50935 req_id = c26098ce-265d-4345-a75a-f0879fd9950a response_code = 204 uri = /eip-gateways
26812024-12-18T19:55:33.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50935 req_id = dee8849c-fe94-40e1-a328-79a31b163906 response_code = 204 uri = /vpc-routes
26822024-12-18T19:55:33.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57703
26832024-12-18T19:55:33.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26842024-12-18T19:55:33.914ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26852024-12-18T19:55:33.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57703 req_id = 18b16098-6399-4176-b8c3-0dc12c78ce9b response_code = 204 uri = /switch-ports
26862024-12-18T19:55:33.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32967
26872024-12-18T19:55:33.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43493
26882024-12-18T19:55:33.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49501
26892024-12-18T19:55:33.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32967 req_id = 3c6afabe-a5ea-4f3f-bcb8-e4f7e9a4b2a1 response_code = 200 uri = /v2p
26902024-12-18T19:55:33.970ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26912024-12-18T19:55:33.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43493 req_id = bd8cd8d1-d11b-4041-a75c-0047b5131f32 response_code = 200 uri = /v2p
26922024-12-18T19:55:33.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57703 req_id = 4678e030-7302-4057-8366-ff71002c43c9 response_code = 200 uri = /network-bootstore-config
26932024-12-18T19:55:33.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32997
26942024-12-18T19:55:33.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32997 req_id = 07045370-6dd6-406c-8168-cb9be8425623 response_code = 200 uri = /vpc-routes
26952024-12-18T19:55:33.996ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
26962024-12-18T19:55:33.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32997 req_id = 9f37df9f-41ac-478e-9f88-590773f1dfc9 response_code = 204 uri = /eip-gateways
26972024-12-18T19:55:34.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26982024-12-18T19:55:34.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62292
26992024-12-18T19:55:34.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62292 req_id = 3d561183-ac8a-4a5e-b33e-9107a9024724 response_code = 200 uri = /v2p
27002024-12-18T19:55:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 976 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32997 req_id = 86397cca-03dd-4d4c-a8bc-68148ef1b535 response_code = 204 uri = /vpc-routes
27012024-12-18T19:55:34.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49501 req_id = b26bccdb-3e88-4201-acd7-6eb1cfe4a767 response_code = 204 uri = /switch-ports
27022024-12-18T19:55:34.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49501 req_id = 8d7d714b-4fd9-4def-80a0-fe42ee7937ef response_code = 200 uri = /network-bootstore-config
27032024-12-18T19:55:34.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36546
27042024-12-18T19:55:34.075ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27052024-12-18T19:55:34.112ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27062024-12-18T19:55:34.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92204 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36546 req_id = e55e4421-3928-4a27-8b42-acb4b5ebe3bc response_code = 204 uri = /switch-ports
27072024-12-18T19:55:34.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36546 req_id = ce5a89d3-b437-47f9-b97c-795f448f3de0 response_code = 200 uri = /network-bootstore-config
27082024-12-18T19:55:44.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6889 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 4721fa59-a4ca-49de-8429-743f88fe0fb5 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
27092024-12-18T19:55:57.589ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51895
27102024-12-18T19:55:57.589ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51895 req_id = f06b4b1c-3784-411f-b12e-a1d6d2e4c7ef response_code = 200 uri = /baseboard
27112024-12-18T19:56:03.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63119
27122024-12-18T19:56:03.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63119 req_id = 06a27a32-979e-4519-a811-997e662c4de2 response_code = 200 uri = /vpc-routes
27132024-12-18T19:56:03.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36158
27142024-12-18T19:56:03.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 5c32fe17-9ee3-4521-8a3c-f54b5748c3dc response_code = 200 uri = /vpc-routes
27152024-12-18T19:56:03.554ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27162024-12-18T19:56:03.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 37c45f9d-b651-4203-b220-b130325f5672 response_code = 204 uri = /eip-gateways
27172024-12-18T19:56:03.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36158 req_id = 2e725bbc-f018-4657-815a-8eb4ad2aa72b response_code = 204 uri = /vpc-routes
27182024-12-18T19:56:03.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41275
27192024-12-18T19:56:03.589ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27202024-12-18T19:56:03.640ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27212024-12-18T19:56:03.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128551 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41275 req_id = 12da8eab-7fd2-4a42-8ca8-5cf688d4f898 response_code = 204 uri = /switch-ports
27222024-12-18T19:56:03.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44017
27232024-12-18T19:56:03.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27242024-12-18T19:56:03.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63119 req_id = 6150297b-fab7-4284-94b4-f5c73364e3f8 response_code = 204 uri = /eip-gateways
27252024-12-18T19:56:03.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42938
27262024-12-18T19:56:03.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58116
27272024-12-18T19:56:03.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41275 req_id = 274dcd7d-a003-49ad-860e-689c8fed5642 response_code = 200 uri = /network-bootstore-config
27282024-12-18T19:56:03.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44017 req_id = e4a2670f-fce4-4517-8023-29c076c76c83 response_code = 200 uri = /v2p
27292024-12-18T19:56:03.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27302024-12-18T19:56:03.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58116 req_id = 8648949d-7450-4d2e-9064-a505a64eab1b response_code = 200 uri = /v2p
27312024-12-18T19:56:03.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63119 req_id = b2ec0bd5-632c-4f90-ae4d-c55989ddd4dd response_code = 204 uri = /vpc-routes
27322024-12-18T19:56:03.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27332024-12-18T19:56:03.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100476 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42938 req_id = ba196503-14fe-4a8f-9f23-2d614bea9d4f response_code = 204 uri = /switch-ports
27342024-12-18T19:56:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42938 req_id = 8f5c8dce-5fe8-4c96-b5e0-1e54e3628a1b response_code = 200 uri = /network-bootstore-config
27352024-12-18T19:56:03.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57244
27362024-12-18T19:56:03.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57244 req_id = 52a45d84-6650-4b6f-a221-26a97769ec4b response_code = 200 uri = /vpc-routes
27372024-12-18T19:56:03.903ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27382024-12-18T19:56:03.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57244 req_id = 5dd2075b-4846-45e9-8d62-839d2ab70cf5 response_code = 204 uri = /eip-gateways
27392024-12-18T19:56:03.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51266
27402024-12-18T19:56:03.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51266 req_id = c41dc81c-702f-467a-95e3-661e68ebe450 response_code = 200 uri = /v2p
27412024-12-18T19:56:03.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57244 req_id = d4715aa4-9300-441a-81c0-86efb363036d response_code = 204 uri = /vpc-routes
27422024-12-18T19:56:03.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42057
27432024-12-18T19:56:03.965ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27442024-12-18T19:56:04.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27452024-12-18T19:56:04.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98247 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42057 req_id = b173040e-c4e7-464d-ab63-ecf8d64465d3 response_code = 204 uri = /switch-ports
27462024-12-18T19:56:04.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42057 req_id = d8067a7e-fbba-41f5-8b43-b2e89c74bc9a response_code = 200 uri = /network-bootstore-config
27472024-12-18T19:56:14.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7043 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 304c7a91-3770-44af-bcc4-ac13d5aefc79 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
27482024-12-18T19:56:27.625ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53778
27492024-12-18T19:56:27.625ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53778 req_id = 4e8e0460-8bf6-4351-a8cd-361b083820d7 response_code = 200 uri = /baseboard
27502024-12-18T19:56:33.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35644
27512024-12-18T19:56:33.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35644 req_id = b576471c-95d7-4228-881f-baa847ac7743 response_code = 200 uri = /vpc-routes
27522024-12-18T19:56:33.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63741
27532024-12-18T19:56:33.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63741 req_id = 0b714e97-fcf6-46dc-b8db-efac9ca2d350 response_code = 200 uri = /vpc-routes
27542024-12-18T19:56:33.727ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27552024-12-18T19:56:33.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35644 req_id = ae4dc9c4-3699-4605-a6e4-a369dbc6e8f4 response_code = 204 uri = /eip-gateways
27562024-12-18T19:56:33.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60473
27572024-12-18T19:56:33.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60473 req_id = a749320e-edca-427b-a105-0ad812608476 response_code = 200 uri = /v2p
27582024-12-18T19:56:33.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27592024-12-18T19:56:33.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63741 req_id = b07e7e5b-47c3-42fa-8b9c-44dbc12bac7d response_code = 204 uri = /eip-gateways
27602024-12-18T19:56:33.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63741 req_id = 48d8b499-e05d-478c-a881-09574b985809 response_code = 204 uri = /vpc-routes
27612024-12-18T19:56:33.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64941
27622024-12-18T19:56:33.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64941 req_id = b13c24e6-2fa6-48a6-aee2-5ab22242dea3 response_code = 200 uri = /v2p
27632024-12-18T19:56:33.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35644 req_id = 29bb603a-8baf-4f92-acc6-00bc10af5429 response_code = 204 uri = /vpc-routes
27642024-12-18T19:56:33.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62986
27652024-12-18T19:56:33.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27662024-12-18T19:56:33.980ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27672024-12-18T19:56:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100667 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62986 req_id = d761812f-7f6f-4abf-86bc-315c782b6e12 response_code = 204 uri = /switch-ports
27682024-12-18T19:56:34.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63053
27692024-12-18T19:56:34.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58860
27702024-12-18T19:56:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58860 req_id = da7dcc30-737a-4def-9277-27b3684189ff response_code = 200 uri = /vpc-routes
27712024-12-18T19:56:34.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27722024-12-18T19:56:34.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62986 req_id = 7b007a2a-27e8-494a-995b-efe2e39842fb response_code = 200 uri = /network-bootstore-config
27732024-12-18T19:56:34.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40547
27742024-12-18T19:56:34.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40547 req_id = 9b2d4772-5f2e-4cf8-8029-0a988d9eae8e response_code = 200 uri = /v2p
27752024-12-18T19:56:34.078ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27762024-12-18T19:56:34.082ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27772024-12-18T19:56:34.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58860 req_id = ac6a675f-d685-4e47-a76c-5b56a411db0f response_code = 204 uri = /eip-gateways
27782024-12-18T19:56:34.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1060 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58860 req_id = 9a6f7ce2-ca7f-4708-a49d-2666df5cac78 response_code = 204 uri = /vpc-routes
27792024-12-18T19:56:34.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63053 req_id = 3be1760f-36ef-4461-a787-186182265543 response_code = 204 uri = /switch-ports
27802024-12-18T19:56:34.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63053 req_id = 6b23815b-205c-4437-96ab-725397414157 response_code = 200 uri = /network-bootstore-config
27812024-12-18T19:56:34.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52588
27822024-12-18T19:56:34.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27832024-12-18T19:56:34.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27842024-12-18T19:56:34.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87576 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52588 req_id = 2fb5dd33-acda-47ae-a952-762f4a524430 response_code = 204 uri = /switch-ports
27852024-12-18T19:56:34.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52588 req_id = 9428220c-6bd3-48c5-b826-6fc52f13f531 response_code = 200 uri = /network-bootstore-config
27862024-12-18T19:56:44.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7042 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = f4da138c-a099-4831-a582-6912c53b5b0e response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
27872024-12-18T19:56:57.660ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34957
27882024-12-18T19:56:57.661ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34957 req_id = 0dd29c2f-3551-4950-a85c-8608559538b1 response_code = 200 uri = /baseboard
27892024-12-18T19:57:03.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62246
27902024-12-18T19:57:03.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62246 req_id = 2630b014-022f-40ed-86d0-b4fcde16b1c9 response_code = 200 uri = /vpc-routes
27912024-12-18T19:57:03.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60671
27922024-12-18T19:57:03.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60671 req_id = 571f927b-37ca-405c-a17f-a8b289f5197a response_code = 200 uri = /vpc-routes
27932024-12-18T19:57:03.502ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27942024-12-18T19:57:03.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60671 req_id = ab6d0b57-1940-4364-b88c-0b41ea81981a response_code = 204 uri = /eip-gateways
27952024-12-18T19:57:03.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60671 req_id = ed697f45-4011-462c-84e6-82f1585227a4 response_code = 204 uri = /vpc-routes
27962024-12-18T19:57:03.544ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
27972024-12-18T19:57:03.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62246 req_id = a1477e91-d1b7-4fdb-ade8-8843eddc05a3 response_code = 204 uri = /eip-gateways
27982024-12-18T19:57:03.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60751
27992024-12-18T19:57:03.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28002024-12-18T19:57:03.648ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28012024-12-18T19:57:03.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60751 req_id = 2eed15aa-e59d-4d7a-bdc9-c03350f0db9c response_code = 204 uri = /switch-ports
28022024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56894
28032024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53229
28042024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60751 req_id = 8e163067-650e-4720-954a-403670e75bfd response_code = 200 uri = /network-bootstore-config
28052024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62246 req_id = 5d17b90c-0e64-4004-ab8c-c03a534f7cad response_code = 204 uri = /vpc-routes
28062024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56894 req_id = 025b9c7a-7680-4054-beea-4c54cf6ff2b7 response_code = 200 uri = /v2p
28072024-12-18T19:57:03.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53229 req_id = 1693804f-5319-4e56-b102-47198df63b4f response_code = 200 uri = /v2p
28082024-12-18T19:57:03.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44477
28092024-12-18T19:57:03.745ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28102024-12-18T19:57:03.797ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28112024-12-18T19:57:03.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44477 req_id = d5855390-c857-4ec7-9731-98ecf094cda3 response_code = 204 uri = /switch-ports
28122024-12-18T19:57:03.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37976
28132024-12-18T19:57:03.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37976 req_id = 062ec4fd-dca6-4caa-971c-a0cf0f5f246c response_code = 200 uri = /vpc-routes
28142024-12-18T19:57:03.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44477 req_id = d200f823-cebb-4e68-9131-9f4dc113991b response_code = 200 uri = /network-bootstore-config
28152024-12-18T19:57:03.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36919
28162024-12-18T19:57:03.930ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28172024-12-18T19:57:03.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28182024-12-18T19:57:04.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106437 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36919 req_id = 114f33e6-4498-4a4a-9c1c-d42dd690c672 response_code = 204 uri = /switch-ports
28192024-12-18T19:57:04.036ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28202024-12-18T19:57:04.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37976 req_id = 0fc0dbeb-2906-41a2-b479-4f71ea87fd3b response_code = 204 uri = /eip-gateways
28212024-12-18T19:57:04.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36919 req_id = 3b3a17b3-87d3-4f79-8aca-7417f6126b57 response_code = 200 uri = /network-bootstore-config
28222024-12-18T19:57:04.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57956
28232024-12-18T19:57:04.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57956 req_id = 93430056-1318-431c-8b39-11ca649066af response_code = 200 uri = /v2p
28242024-12-18T19:57:04.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37976 req_id = b87c58e5-442d-43c7-837f-b7ef2ef1195c response_code = 204 uri = /vpc-routes
28252024-12-18T19:57:14.551ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8762 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 4b7b5b57-875a-4f03-ae05-7e821f90d96a response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
28262024-12-18T19:57:27.693ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59782
28272024-12-18T19:57:27.693ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59782 req_id = fd17b1e0-1e7e-4e9e-89ee-6b19038b4a17 response_code = 200 uri = /baseboard
28282024-12-18T19:57:33.695ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50516
28292024-12-18T19:57:33.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50516 req_id = 93357915-edbe-4db1-8807-e972e106ea85 response_code = 200 uri = /vpc-routes
28302024-12-18T19:57:33.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43519
28312024-12-18T19:57:33.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43519 req_id = d027966e-2977-4ed4-bd7e-db4e41fe2ff4 response_code = 200 uri = /vpc-routes
28322024-12-18T19:57:33.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28332024-12-18T19:57:33.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50516 req_id = 2ee5e339-e3ac-4a34-bb92-4b4093bc926d response_code = 204 uri = /eip-gateways
28342024-12-18T19:57:33.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50516 req_id = 0e62a7a1-9f87-4c8b-aaf1-95e9bfaeffe4 response_code = 204 uri = /vpc-routes
28352024-12-18T19:57:33.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33377
28362024-12-18T19:57:33.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28372024-12-18T19:57:33.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28382024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33377 req_id = 2231e670-1f33-49a2-ac37-63fdda2ed909 response_code = 204 uri = /switch-ports
28392024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51396
28402024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41594
28412024-12-18T19:57:33.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28422024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43519 req_id = 40918514-849b-49c9-b336-4c0de5ec0cc8 response_code = 204 uri = /eip-gateways
28432024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34399
28442024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34399 req_id = 72d90046-7efb-4d94-ac20-5613616d23a3 response_code = 200 uri = /vpc-routes
28452024-12-18T19:57:33.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33377 req_id = c8b15260-27e0-4b18-920a-121046c30095 response_code = 200 uri = /network-bootstore-config
28462024-12-18T19:57:33.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51396 req_id = 12f024ac-db92-4122-96aa-3b6fdaf3fa64 response_code = 200 uri = /v2p
28472024-12-18T19:57:33.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28482024-12-18T19:57:34.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42502
28492024-12-18T19:57:34.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42502 req_id = 86011bc5-c030-4ebf-9b7f-24211086040f response_code = 200 uri = /v2p
28502024-12-18T19:57:34.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43519 req_id = 0bdf56de-b917-4e57-8a2c-cd56e3f04c27 response_code = 204 uri = /vpc-routes
28512024-12-18T19:57:34.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28522024-12-18T19:57:34.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28532024-12-18T19:57:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34399 req_id = 2e833718-6d24-41eb-b8ec-ad0916be3965 response_code = 204 uri = /eip-gateways
28542024-12-18T19:57:34.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34399 req_id = 8298c327-645b-4cc3-89a0-0ab7f80b32f4 response_code = 204 uri = /vpc-routes
28552024-12-18T19:57:34.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39342
28562024-12-18T19:57:34.096ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28572024-12-18T19:57:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41594 req_id = 620dd008-8bdb-4a9b-9ed9-682a96cd5c51 response_code = 204 uri = /switch-ports
28582024-12-18T19:57:34.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 809 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41594 req_id = 25fa96ba-bcef-48e0-bd08-8e8c22165d6b response_code = 200 uri = /network-bootstore-config
28592024-12-18T19:57:34.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28602024-12-18T19:57:34.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57821
28612024-12-18T19:57:34.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57821 req_id = abd7b8a2-1536-4fb5-98a4-a72ffbfca8df response_code = 200 uri = /v2p
28622024-12-18T19:57:34.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39342 req_id = 821624af-8a82-488e-8630-ac6672afec3e response_code = 204 uri = /switch-ports
28632024-12-18T19:57:34.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39342 req_id = 43efaf34-8570-4e92-9638-0c3e8ce58e31 response_code = 200 uri = /network-bootstore-config
28642024-12-18T19:57:44.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7020 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 6d1112be-d479-49f0-b7d6-6b273c4723a3 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
28652024-12-18T19:57:57.729ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63259
28662024-12-18T19:57:57.729ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63259 req_id = 28bbe8f4-9426-4d3c-a346-4cfb49b21636 response_code = 200 uri = /baseboard
28672024-12-18T19:58:03.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43394
28682024-12-18T19:58:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43394 req_id = 09a1047a-6636-40ba-858d-5662e726a326 response_code = 200 uri = /vpc-routes
28692024-12-18T19:58:03.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41379
28702024-12-18T19:58:03.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41379 req_id = 38fa72a9-6bde-40b8-bb46-161759e4dc73 response_code = 200 uri = /vpc-routes
28712024-12-18T19:58:03.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59036
28722024-12-18T19:58:03.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28732024-12-18T19:58:03.719ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28742024-12-18T19:58:03.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59036 req_id = 4a1d31d8-1cc1-49ac-a7f9-33ba9ebfc0c3 response_code = 204 uri = /switch-ports
28752024-12-18T19:58:03.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39673
28762024-12-18T19:58:03.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28772024-12-18T19:58:03.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41966
28782024-12-18T19:58:03.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41379 req_id = 9c2bcd79-4bf6-46c3-8a27-33329bc4804e response_code = 204 uri = /eip-gateways
28792024-12-18T19:58:03.793ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28802024-12-18T19:58:03.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43394 req_id = cee01e83-58e1-439d-913f-945a7461df4f response_code = 204 uri = /eip-gateways
28812024-12-18T19:58:03.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39673 req_id = 1aebc64d-0296-4001-bd27-dbb546cbd8c8 response_code = 200 uri = /v2p
28822024-12-18T19:58:03.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59036 req_id = c6cdb9df-d37e-4982-b882-ed859763cb85 response_code = 200 uri = /network-bootstore-config
28832024-12-18T19:58:03.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41966 req_id = a3d01684-468a-43d7-8543-60c3e2f1294a response_code = 200 uri = /v2p
28842024-12-18T19:58:03.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47197
28852024-12-18T19:58:03.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28862024-12-18T19:58:03.837ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28872024-12-18T19:58:03.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98530 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47197 req_id = 17c1aa15-3a70-44a6-b03a-04dc124bbce5 response_code = 204 uri = /switch-ports
28882024-12-18T19:58:03.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47735
28892024-12-18T19:58:03.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47735 req_id = c1fdb557-8a5b-4aa1-a667-62ff2c1f5834 response_code = 200 uri = /vpc-routes
28902024-12-18T19:58:03.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47197 req_id = 586a5ee0-2068-4bdc-a9ca-dd8fde6bb9c1 response_code = 200 uri = /network-bootstore-config
28912024-12-18T19:58:03.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 521 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41379 req_id = 8cf85783-ca1b-4e10-8ba6-b7615ca9f866 response_code = 204 uri = /vpc-routes
28922024-12-18T19:58:03.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43394 req_id = b424bca3-3baf-4be2-b668-85ff4b048d86 response_code = 204 uri = /vpc-routes
28932024-12-18T19:58:03.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
28942024-12-18T19:58:03.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47735 req_id = 41b56750-3c1d-4abe-9b52-f95496dc10d0 response_code = 204 uri = /eip-gateways
28952024-12-18T19:58:03.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56778
28962024-12-18T19:58:03.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56778 req_id = 05d5e18e-6564-47ea-8b16-18d109a64d26 response_code = 200 uri = /v2p
28972024-12-18T19:58:03.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39169
28982024-12-18T19:58:03.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28992024-12-18T19:58:04.000ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29002024-12-18T19:58:04.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96683 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39169 req_id = 5de18343-15e6-4f9b-b43a-2295547a5d2e response_code = 204 uri = /switch-ports
29012024-12-18T19:58:04.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39169 req_id = 24607c1f-90b1-4b5c-8042-6259905f80ce response_code = 200 uri = /network-bootstore-config
29022024-12-18T19:58:04.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 417 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47735 req_id = 57fa06e7-eedf-4dc2-8174-b5a9f6c1de49 response_code = 204 uri = /vpc-routes
29032024-12-18T19:58:14.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7765 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 35e32b21-846f-4290-8be6-6a2f5b919d4c response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
29042024-12-18T19:58:27.762ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36952
29052024-12-18T19:58:27.763ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36952 req_id = 7b4b954b-4485-46b2-86ef-125587b23366 response_code = 200 uri = /baseboard
29062024-12-18T19:58:33.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50412
29072024-12-18T19:58:33.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50412 req_id = bd74343e-d854-4518-987a-c918f0310290 response_code = 200 uri = /vpc-routes
29082024-12-18T19:58:33.846ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
29092024-12-18T19:58:33.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50412 req_id = 0d984ee9-427e-4f94-8a00-a94b996db229 response_code = 204 uri = /eip-gateways
29102024-12-18T19:58:33.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50412 req_id = 086b9314-176c-446f-9832-f0ccb417045c response_code = 204 uri = /vpc-routes
29112024-12-18T19:58:33.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34363
29122024-12-18T19:58:33.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34363 req_id = f47f2ec4-bee3-47d4-917d-0d2e58cf3ea2 response_code = 200 uri = /v2p
29132024-12-18T19:58:33.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52851
29142024-12-18T19:58:33.963ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29152024-12-18T19:58:34.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29162024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132319 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52851 req_id = 44f2cef4-5ad0-4f8d-b392-5b36ae7e1c24 response_code = 204 uri = /switch-ports
29172024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36353
29182024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42162
29192024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61746
29202024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38486
29212024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50535
29222024-12-18T19:58:34.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40901
29232024-12-18T19:58:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38486 req_id = 2ac72252-8aab-4eb4-9801-a9fbf6ffec9c response_code = 200 uri = /vpc-routes
29242024-12-18T19:58:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 430 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52851 req_id = 345e4450-cc47-48be-81d9-3560959336b1 response_code = 200 uri = /network-bootstore-config
29252024-12-18T19:58:34.096ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29262024-12-18T19:58:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42162 req_id = be0f7098-12fe-451a-8ca7-36b1862a5a53 response_code = 200 uri = /vpc-routes
29272024-12-18T19:58:34.096ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29282024-12-18T19:58:34.096ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29292024-12-18T19:58:34.096ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
29302024-12-18T19:58:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61746 req_id = cc9a5a7b-dfae-4d14-8759-66561abaa370 response_code = 200 uri = /v2p
29312024-12-18T19:58:34.105ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
29322024-12-18T19:58:34.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45848
29332024-12-18T19:58:34.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45848 req_id = 69b43ab0-05c7-4aaf-9be2-0570c004268d response_code = 200 uri = /v2p
29342024-12-18T19:58:34.123ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29352024-12-18T19:58:34.123ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
29362024-12-18T19:58:34.146ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29372024-12-18T19:58:34.153ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29382024-12-18T19:58:34.153ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
29392024-12-18T19:58:34.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
29402024-12-18T19:58:34.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
29412024-12-18T19:58:34.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38486 req_id = 4180c3ac-4d91-4932-891f-09b44e77cd29 response_code = 204 uri = /eip-gateways
29422024-12-18T19:58:34.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42162 req_id = 45d950a2-f4a7-4416-a87c-71acb26c9929 response_code = 204 uri = /eip-gateways
29432024-12-18T19:58:34.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38486 req_id = 1a9b0b39-87a2-4e14-8c6d-f6869d6c58b7 response_code = 204 uri = /vpc-routes
29442024-12-18T19:58:34.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42162 req_id = 40e012dc-c9d6-44f2-a099-f74b6f1b97d3 response_code = 204 uri = /vpc-routes
29452024-12-18T19:58:34.185ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29462024-12-18T19:58:34.186ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
29472024-12-18T19:58:34.215ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29482024-12-18T19:58:34.215ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
29492024-12-18T19:58:34.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29502024-12-18T19:58:34.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129389 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50535 req_id = 05c88653-9332-4411-957d-875e257fbc10 response_code = 204 uri = /switch-ports
29512024-12-18T19:58:34.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 769 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50535 req_id = 053be77b-1b65-425b-84cf-f0ad7fa10e11 response_code = 200 uri = /network-bootstore-config
29522024-12-18T19:58:34.241ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29532024-12-18T19:58:34.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
29542024-12-18T19:58:34.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57493
29552024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29562024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29572024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29582024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29592024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29602024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29612024-12-18T19:58:34.246ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29622024-12-18T19:58:34.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57493 req_id = 7c7566dc-5bac-45fd-bca8-a27dff5a9808 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29632024-12-18T19:58:34.263ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29642024-12-18T19:58:34.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29652024-12-18T19:58:34.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
29662024-12-18T19:58:34.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64703
29672024-12-18T19:58:34.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29682024-12-18T19:58:34.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
29692024-12-18T19:58:34.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
29702024-12-18T19:58:34.287ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
29712024-12-18T19:58:34.292ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29722024-12-18T19:58:34.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
29732024-12-18T19:58:34.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60050
29742024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29752024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29762024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29772024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29782024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29792024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29802024-12-18T19:58:34.301ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29812024-12-18T19:58:34.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60050 req_id = 139eacbf-6cdd-42a2-99b7-dcc66a51e578 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29822024-12-18T19:58:34.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29832024-12-18T19:58:34.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
29842024-12-18T19:58:34.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48574
29852024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 82dd2f4e-7381-43e3-afa8-59511127db43, kind: Service { id: 9da4e3ea-a57c-4b2b-81c3-7f374155d667 }, name: Name("external-dns-9da4e3ea-a57c-4b2b-81c3-7f374155d667"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 61])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 887bc85f-0e44-4453-b767-1123deef8e32, kind: Service { id: 4e3d8b46-b399-4d3c-bc66-63409f4abd06 }, name: Name("external-dns-4e3d8b46-b399-4d3c-bc66-63409f4abd06"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 131, 162])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e4da183-4df6-4727-ab9e-2d43eee7f509, kind: Service { id: e8590144-bfff-4d2e-aa70-065d47db3a0f }, name: Name("nexus-e8590144-bfff-4d2e-aa70-065d47db3a0f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 170])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4622cfe7-8061-4db7-addd-b57f0a8c6785, kind: Service { id: 1139ebda-6055-49a8-8243-f0019044de70 }, name: Name("nexus-1139ebda-6055-49a8-8243-f0019044de70"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 115])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 9c1d8b56-ec72-4f5f-9a0b-469561ae3766, kind: Service { id: d62a7c10-1ef0-4907-b646-cd126a8e8a9b }, name: Name("nexus-d62a7c10-1ef0-4907-b646-cd126a8e8a9b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 232, 62])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
29862024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29872024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29882024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29892024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
29902024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
29912024-12-18T19:58:34.322ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
29922024-12-18T19:58:34.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 588 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48574 req_id = de51665c-7273-4f7e-a050-f28c2247491e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
29932024-12-18T19:58:34.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236563 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40901 req_id = 5f975c71-c08f-4e5d-8371-310e12086046 response_code = 204 uri = /switch-ports
29942024-12-18T19:58:34.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40901 req_id = 90c1c443-ef26-4735-a6de-3d8de174481e response_code = 200 uri = /network-bootstore-config
29952024-12-18T19:58:34.336ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29962024-12-18T19:58:34.336ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
29972024-12-18T19:58:34.350ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
29982024-12-18T19:58:34.350ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
29992024-12-18T19:58:34.365ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30002024-12-18T19:58:34.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
30012024-12-18T19:58:34.379ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30022024-12-18T19:58:34.379ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
30032024-12-18T19:58:34.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300990 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36353 req_id = 45469316-d284-4811-90b3-6c731da3dfcc response_code = 200 uri = /inventory
30042024-12-18T19:58:34.403ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30052024-12-18T19:58:34.403ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
30062024-12-18T19:58:34.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30072024-12-18T19:58:34.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
30082024-12-18T19:58:34.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30092024-12-18T19:58:34.452ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
30102024-12-18T19:58:34.472ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30112024-12-18T19:58:34.473ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
30122024-12-18T19:58:34.495ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30132024-12-18T19:58:34.495ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
30142024-12-18T19:58:34.518ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30152024-12-18T19:58:34.518ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
30162024-12-18T19:58:34.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64703 req_id = de1fa5d8-3f29-44e7-b049-f16fc33b30b7 response_code = 200 uri = /inventory
30172024-12-18T19:58:35.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34533
30182024-12-18T19:58:35.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30192024-12-18T19:58:35.125ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30202024-12-18T19:58:35.125ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f1657089-065e-4651-a353-e5d94949a179/config/omicron-zones.json file = common/src/ledger.rs:177
30212024-12-18T19:58:35.125ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/config/omicron-zones.json file = common/src/ledger.rs:177
30222024-12-18T19:58:35.139ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc4bf5f-823b-4004-892a-72049fa9dd2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30232024-12-18T19:58:35.139ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc4bf5f-823b-4004-892a-72049fa9dd2d
30242024-12-18T19:58:35.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4585f13b-0248-4d0e-a56e-45d95198a363 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30252024-12-18T19:58:35.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4585f13b-0248-4d0e-a56e-45d95198a363
30262024-12-18T19:58:35.187ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b2f32ee3-8e81-4491-bdc2-61259f84a111 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30272024-12-18T19:58:35.187ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b2f32ee3-8e81-4491-bdc2-61259f84a111
30282024-12-18T19:58:35.208ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 415023e8-4b60-4f50-85ce-5d337214083f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30292024-12-18T19:58:35.208ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_415023e8-4b60-4f50-85ce-5d337214083f
30302024-12-18T19:58:35.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3943ba64-84f5-40ee-94de-ef33bd94d891 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30312024-12-18T19:58:35.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_3943ba64-84f5-40ee-94de-ef33bd94d891
30322024-12-18T19:58:35.252ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3612c32-5622-4a67-9ae3-29c036aec45e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30332024-12-18T19:58:35.252ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_c3612c32-5622-4a67-9ae3-29c036aec45e
30342024-12-18T19:58:35.273ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 32d90d79-6a5e-46e0-95ee-42ca469395c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30352024-12-18T19:58:35.273ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_32d90d79-6a5e-46e0-95ee-42ca469395c6
30362024-12-18T19:58:35.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3387fe8-8213-4b32-a12a-44f87d74c32a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30372024-12-18T19:58:35.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3387fe8-8213-4b32-a12a-44f87d74c32a
30382024-12-18T19:58:35.315ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 96909843-abb5-4785-acdb-8d286f18ea02 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
30392024-12-18T19:58:35.315ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_96909843-abb5-4785-acdb-8d286f18ea02
30402024-12-18T19:58:35.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34533 req_id = ba076636-e1b7-4a5b-943a-f7abfd5c99e1 response_code = 200 uri = /inventory
30412024-12-18T19:58:44.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7344 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 30fe7a76-24db-4a65-9f0f-3a057bce05b7 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
30422024-12-18T19:58:57.795ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39763
30432024-12-18T19:58:57.795ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39763 req_id = 29e00e28-4238-4819-b29e-ffdc4bd2976d response_code = 200 uri = /baseboard
30442024-12-18T19:59:03.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63007
30452024-12-18T19:59:03.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63007 req_id = 5950cb84-0ce5-4928-bd69-8accd8bfdd6b response_code = 200 uri = /vpc-routes
30462024-12-18T19:59:03.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44089
30472024-12-18T19:59:03.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44089 req_id = baeda567-cdc4-48ad-b5ad-b668f8c2545d response_code = 200 uri = /vpc-routes
30482024-12-18T19:59:03.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51770
30492024-12-18T19:59:03.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51770 req_id = 0e8f42a6-e912-44d7-82dc-d93fe5583c40 response_code = 200 uri = /v2p
30502024-12-18T19:59:03.597ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
30512024-12-18T19:59:03.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63007 req_id = f9ade814-86a5-4824-aaa2-d0aba3ad8cc3 response_code = 204 uri = /eip-gateways
30522024-12-18T19:59:03.606ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
30532024-12-18T19:59:03.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44089 req_id = e15eea61-9108-48b1-b5b5-ae4de3aec73f response_code = 204 uri = /eip-gateways
30542024-12-18T19:59:03.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63007 req_id = c480b99a-68f6-4ded-a237-ec0e84b64114 response_code = 204 uri = /vpc-routes
30552024-12-18T19:59:03.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44089 req_id = 863b7a07-76c9-4692-8804-38bc6e26f881 response_code = 204 uri = /vpc-routes
30562024-12-18T19:59:03.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43026
30572024-12-18T19:59:03.654ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30582024-12-18T19:59:03.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30592024-12-18T19:59:03.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43026 req_id = 05469979-923c-43a2-bd3f-d9e5cb46fdcb response_code = 204 uri = /switch-ports
30602024-12-18T19:59:03.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35347
30612024-12-18T19:59:03.783ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30622024-12-18T19:59:03.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3890 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43026 req_id = afef12b9-d55b-4461-a40c-b87e45abeb37 response_code = 200 uri = /network-bootstore-config
30632024-12-18T19:59:03.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51044
30642024-12-18T19:59:03.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51044 req_id = f121acfb-a770-4dfa-b40f-4ec68c8c70aa response_code = 200 uri = /v2p
30652024-12-18T19:59:03.821ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30662024-12-18T19:59:03.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35347 req_id = 503d82f6-efc7-46ad-8046-3430ae1c4f53 response_code = 204 uri = /switch-ports
30672024-12-18T19:59:03.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35347 req_id = 69dd106c-6f9a-4019-abf7-497bb9b62b27 response_code = 200 uri = /network-bootstore-config
30682024-12-18T19:59:03.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49732
30692024-12-18T19:59:03.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49732 req_id = 6f0e42ba-18a3-46b5-8b99-28560d816001 response_code = 200 uri = /vpc-routes
30702024-12-18T19:59:03.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
30712024-12-18T19:59:03.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49732 req_id = 7fe865a2-e9f6-4c55-b8e0-4cb186ad7d2c response_code = 204 uri = /eip-gateways
30722024-12-18T19:59:03.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49732 req_id = 1912b18a-eefa-47a5-9d75-1679798602d7 response_code = 204 uri = /vpc-routes
30732024-12-18T19:59:03.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58022
30742024-12-18T19:59:03.995ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30752024-12-18T19:59:04.034ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30762024-12-18T19:59:04.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58022 req_id = 7021cf95-c6c5-4b7b-b34b-7c458da4faf2 response_code = 204 uri = /switch-ports
30772024-12-18T19:59:04.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46788
30782024-12-18T19:59:04.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46788 req_id = 005046f8-b088-4b06-bee4-c9355064716a response_code = 200 uri = /v2p
30792024-12-18T19:59:04.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58022 req_id = d7fa8cc3-e596-408e-ada2-f6fb4ad93381 response_code = 200 uri = /network-bootstore-config
30802024-12-18T19:59:14.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7239 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = b5f6bc26-4ccd-4cb8-869f-f6501d96453d response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
30812024-12-18T19:59:27.828ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36868
30822024-12-18T19:59:27.828ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36868 req_id = aeadac42-211e-4242-b11b-0f25139554ab response_code = 200 uri = /baseboard
30832024-12-18T19:59:33.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45616
30842024-12-18T19:59:33.499ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45616 req_id = 83c1c955-4390-47c5-b4f1-3dc75a530d3e response_code = 200 uri = /v2p
30852024-12-18T19:59:33.504ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
30862024-12-18T19:59:33.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41279
30872024-12-18T19:59:33.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41279 req_id = 7feb03b6-1ff5-464e-8dd0-7f7d5900001f response_code = 200 uri = /vpc-routes
30882024-12-18T19:59:33.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44889
30892024-12-18T19:59:33.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44889 req_id = c2d35238-1c4d-4cc4-bfcc-41891850f6dd response_code = 200 uri = /v2p
30902024-12-18T19:59:33.873ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
30912024-12-18T19:59:33.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41279 req_id = 9f0ce0ac-6bed-44b1-bbc0-65ae8b4ec124 response_code = 204 uri = /eip-gateways
30922024-12-18T19:59:33.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44143
30932024-12-18T19:59:33.882ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
30942024-12-18T19:59:33.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
30952024-12-18T19:59:34.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119174 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44143 req_id = 7a25b202-d100-42b2-ba70-2f51256ff592 response_code = 204 uri = /switch-ports
30962024-12-18T19:59:34.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47862
30972024-12-18T19:59:34.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33281
30982024-12-18T19:59:34.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41279 req_id = 41e5e1ae-3774-4eb4-baa7-64428edd4cb5 response_code = 204 uri = /vpc-routes
30992024-12-18T19:59:34.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44143 req_id = 47030f0b-b391-43af-96ab-d884bc9ae189 response_code = 200 uri = /network-bootstore-config
31002024-12-18T19:59:34.002ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31012024-12-18T19:59:34.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47862 req_id = 3fe2d881-72c2-4a77-8ca7-2729cc98ddcc response_code = 200 uri = /vpc-routes
31022024-12-18T19:59:34.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57504
31032024-12-18T19:59:34.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57504 req_id = 2ff513af-9ab0-4633-aad3-aa1a0a303eb8 response_code = 200 uri = /vpc-routes
31042024-12-18T19:59:34.050ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31052024-12-18T19:59:34.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
31062024-12-18T19:59:34.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47862 req_id = e7577720-dac9-4112-b9bf-1fa4a9a75967 response_code = 204 uri = /eip-gateways
31072024-12-18T19:59:34.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 440 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47862 req_id = b53913e3-a281-49eb-bba7-b5dc63262d60 response_code = 204 uri = /vpc-routes
31082024-12-18T19:59:34.095ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
31092024-12-18T19:59:34.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57504 req_id = 6bdb7a0d-d9bd-4f5b-983a-ebe802880765 response_code = 204 uri = /eip-gateways
31102024-12-18T19:59:34.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1038 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57504 req_id = 65db6826-2e74-4328-9220-474d4b93c3f6 response_code = 204 uri = /vpc-routes
31112024-12-18T19:59:34.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33281 req_id = 6d4382d3-3f54-45be-9883-3fb490070d3c response_code = 204 uri = /switch-ports
31122024-12-18T19:59:34.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33281 req_id = e20ac025-609f-4365-ad55-7ce4f958ae32 response_code = 200 uri = /network-bootstore-config
31132024-12-18T19:59:34.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50630
31142024-12-18T19:59:34.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31152024-12-18T19:59:34.280ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31162024-12-18T19:59:34.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98364 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50630 req_id = ba6a8884-f44f-4902-bb06-af58b398699e response_code = 204 uri = /switch-ports
31172024-12-18T19:59:34.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56463
31182024-12-18T19:59:34.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50630 req_id = e9153a59-933c-496f-8ff7-42c036aaec02 response_code = 200 uri = /network-bootstore-config
31192024-12-18T19:59:34.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56463 req_id = 91168c3a-a0f4-4ea7-b64f-25c28322e7ce response_code = 200 uri = /v2p
31202024-12-18T19:59:44.553ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10789 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 50963e6b-8de6-44aa-9a3c-8cc9124e1eea response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
31212024-12-18T19:59:57.864ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62871
31222024-12-18T19:59:57.864ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62871 req_id = 43c68de3-479c-49b2-b5fe-c9fd4715ab4d response_code = 200 uri = /baseboard
31232024-12-18T20:00:03.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57946
31242024-12-18T20:00:03.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57946 req_id = a41b7dc3-9ab3-4e50-9927-4911e3099828 response_code = 200 uri = /vpc-routes
31252024-12-18T20:00:03.575ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
31262024-12-18T20:00:03.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57946 req_id = 2ead8367-dde5-4212-9bc3-6feab12c25a4 response_code = 204 uri = /eip-gateways
31272024-12-18T20:00:03.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37713
31282024-12-18T20:00:03.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37713 req_id = 15bc5219-45c4-483a-b9dd-a072d8130837 response_code = 200 uri = /v2p
31292024-12-18T20:00:03.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43718
31302024-12-18T20:00:03.659ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31312024-12-18T20:00:03.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31322024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43718 req_id = 2063e981-d833-4f38-afec-8db32de14e9b response_code = 204 uri = /switch-ports
31332024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54719
31342024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60205
31352024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43718 req_id = ad2814c7-944d-4d0c-83a2-6613babede3f response_code = 200 uri = /network-bootstore-config
31362024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57946 req_id = 10f92ce1-d6f4-4be8-8fc3-594015099ef2 response_code = 204 uri = /vpc-routes
31372024-12-18T20:00:03.786ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31382024-12-18T20:00:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54719 req_id = 263d3ec0-f0f6-4bb2-92ee-e1bb1300dd25 response_code = 200 uri = /vpc-routes
31392024-12-18T20:00:03.832ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31402024-12-18T20:00:03.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
31412024-12-18T20:00:03.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54719 req_id = 91557626-a3e0-46f5-a513-a19dea4a336e response_code = 204 uri = /eip-gateways
31422024-12-18T20:00:03.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64885
31432024-12-18T20:00:03.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64885 req_id = 12d29779-fa52-400c-a6f4-86b5894c47ac response_code = 200 uri = /vpc-routes
31442024-12-18T20:00:03.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41443
31452024-12-18T20:00:03.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41443 req_id = c68ca496-c2ed-4051-87be-306288762951 response_code = 200 uri = /v2p
31462024-12-18T20:00:03.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54719 req_id = fedcb7a6-3f1d-41e1-b243-796cfd68be5e response_code = 204 uri = /vpc-routes
31472024-12-18T20:00:03.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60205 req_id = 40011c1e-7a78-469f-9ba8-aa1bc03e356f response_code = 204 uri = /switch-ports
31482024-12-18T20:00:03.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60205 req_id = 97146f3f-10ba-4a3b-9214-1d5f5890cb9a response_code = 200 uri = /network-bootstore-config
31492024-12-18T20:00:03.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
31502024-12-18T20:00:03.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64885 req_id = 977116dc-b0db-46d5-961c-f3709512206d response_code = 204 uri = /eip-gateways
31512024-12-18T20:00:03.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40327
31522024-12-18T20:00:03.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40327 req_id = e706e38b-bb07-4792-83c4-dc1e3787dc1d response_code = 200 uri = /v2p
31532024-12-18T20:00:03.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64885 req_id = fb9b5e0b-0fce-48cc-8acd-e66cbc15a788 response_code = 204 uri = /vpc-routes
31542024-12-18T20:00:03.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55364
31552024-12-18T20:00:03.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
31562024-12-18T20:00:04.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
31572024-12-18T20:00:04.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89282 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55364 req_id = 2da15e45-2b05-4aae-af88-104af01fd48f response_code = 204 uri = /switch-ports
31582024-12-18T20:00:04.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55364 req_id = f192e9af-38c8-44e9-8b1d-ff67a49bff00 response_code = 200 uri = /network-bootstore-config
31592024-12-18T20:00:14.549ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6662 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = d544e454-e90c-49c6-b521-ea04669444fc response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
31602024-12-18T20:00:23.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50774
31612024-12-18T20:00:23.422ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50774 req_id = 689c796e-c934-4471-b9c4-536c2e0e1fd1 response_code = 200 uri = /v2p
31622024-12-18T20:00:23.425ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(837593) }
31632024-12-18T20:00:23.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3349 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50774 req_id = 90abdb3b-fd80-4d27-b1a9-410f3f4edf84 response_code = 204 uri = /v2p
31642024-12-18T20:00:23.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54638
31652024-12-18T20:00:23.687ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(837593))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b8348b81e34", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ff42d1b7-b179-4c54-9cf8-f6aac8b9b524, read_only_parent: Some(Volume { block_size: 512, id: 2eeadcb5-e359-4a37-849a-d72668d1fc5a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: aba16712-8b4d-49d9-88b8-4455463a519d, key: Some("0lcR9k1HRgQasazP4DltSxQ/HkTSKhHrj5wsFFU1hXc="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ff42d1b7-b179-4c54-9cf8-f6aac8b9b524, key: Some("ZjLht9S1XT5kinRVv4xI/up2BxGgfFlauXUre87YYuM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::12]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-b8348b81e34" }] }), cloud_init_bytes: Some(..) } instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 metadata = InstanceMetadata { silo_id: 9066e168-08ec-47af-a018-fa1edb0a15cb, project_id: f1e5fa16-cf2c-4cd9-a7b3-bce6593650a0 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-18T20:00:23.673082408Z }
31662024-12-18T20:00:23.687ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 migration_id = None propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31672024-12-18T20:00:23.687ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 migration_id = None propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(837593))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: bfb560e0-429e-473e-a379-6f8c8b01bf4b, kind: Instance { id: d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(837593), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-b8348b81e34", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ff42d1b7-b179-4c54-9cf8-f6aac8b9b524, read_only_parent: Some(Volume { block_size: 512, id: 2eeadcb5-e359-4a37-849a-d72668d1fc5a, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: aba16712-8b4d-49d9-88b8-4455463a519d, key: Some("0lcR9k1HRgQasazP4DltSxQ/HkTSKhHrj5wsFFU1hXc="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::13]:19002"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ff42d1b7-b179-4c54-9cf8-f6aac8b9b524, key: Some("ZjLht9S1XT5kinRVv4xI/up2BxGgfFlauXUre87YYuM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19001", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::12]:19001"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-b8348b81e34" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-18T20:00:23.673082408Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
31682024-12-18T20:00:23.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17083 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54638 req_id = 0940d752-8db1-4694-ad03-0b48052298a3 response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652
31692024-12-18T20:00:23.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64370
31702024-12-18T20:00:23.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1747 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64370 req_id = a66555a9-ab16-4d6c-b77e-98701d076c0d response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652/state
31712024-12-18T20:00:23.773ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 837593 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
31722024-12-18T20:00:23.773ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
31732024-12-18T20:00:23.815ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652 file = illumos-utils/src/zone.rs:325 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31742024-12-18T20:00:23.838ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652 file = illumos-utils/src/zone.rs:363 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31752024-12-18T20:00:23.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57875
31762024-12-18T20:00:23.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57875 req_id = e8d2a5fc-79a8-4e1e-b081-9b22748c0209 response_code = 200 uri = /vpc-routes
31772024-12-18T20:00:23.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} }
31782024-12-18T20:00:25.460ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31792024-12-18T20:00:25.460ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31802024-12-18T20:00:25.639ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 33.832743ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31812024-12-18T20:00:25.685ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 116.778538ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31822024-12-18T20:00:25.818ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 293.406691ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31832024-12-18T20:00:26.134ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 254.683717ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31842024-12-18T20:00:26.404ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 587.004781ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31852024-12-18T20:00:27.002ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 852.173306ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31862024-12-18T20:00:27.866ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 1.089963732s file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31872024-12-18T20:00:27.897ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33538
31882024-12-18T20:00:27.897ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33538 req_id = 2878b426-9125-4c36-bc42-8f88a7cbd587 response_code = 200 uri = /baseboard
31892024-12-18T20:00:28.968ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 707.7892ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31902024-12-18T20:00:29.686ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 506.392241ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31912024-12-18T20:00:30.206ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 730.114142ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31922024-12-18T20:00:30.948ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 999.048389ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 zone = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
31932024-12-18T20:00:31.978ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652 file = sled-agent/src/instance.rs:1786 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31942024-12-18T20:00:31.988ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 42.345682ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31952024-12-18T20:00:32.041ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652") failed: Property not found. retry in 61.46219ms file = illumos-utils/src/svc.rs:36 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31962024-12-18T20:00:32.112ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31972024-12-18T20:00:32.154ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31982024-12-18T20:00:32.293ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
31992024-12-18T20:00:32.295ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
32002024-12-18T20:00:32.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8423621 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57875 req_id = b194f275-9117-43bf-aedb-32f1e712d6c1 response_code = 204 uri = /eip-gateways
32012024-12-18T20:00:32.302ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-18T20:00:32.295796917Z } file = sled-agent/src/instance.rs:780 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32022024-12-18T20:00:32.302ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T20:00:32.295796917Z } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32032024-12-18T20:00:32.302ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-18T20:00:32.295796917Z }, migration_in: None, migration_out: None }
32042024-12-18T20:00:32.367ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-18T20:00:32.367049483Z } file = sled-agent/src/instance.rs:780 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32052024-12-18T20:00:32.367ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T20:00:32.367049483Z } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32062024-12-18T20:00:32.367ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-18T20:00:32.367049483Z }, migration_in: None, migration_out: None }
32072024-12-18T20:00:32.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57875 req_id = 1064e8d2-fbdc-451c-b6dd-1ec3ad3480da response_code = 204 uri = /vpc-routes
32082024-12-18T20:00:33.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43806
32092024-12-18T20:00:33.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1389 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43806 req_id = 73da6bf3-5276-4031-934d-dd474d5121ed response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652/state
32102024-12-18T20:00:33.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63728
32112024-12-18T20:00:33.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63728 req_id = af4d1f28-5ecb-44ce-b4b9-1cbf07cfb3b2 response_code = 200 uri = /v2p
32122024-12-18T20:00:33.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49673
32132024-12-18T20:00:33.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49673 req_id = 4a7f8c82-8c82-433a-aca4-16d74ad40152 response_code = 200 uri = /vpc-routes
32142024-12-18T20:00:33.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54649
32152024-12-18T20:00:33.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54649 req_id = 112ee740-bb79-42f0-be6b-e3a86011b4e3 response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652/state
32162024-12-18T20:00:33.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} }
32172024-12-18T20:00:33.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49673 req_id = f5005f8a-2e1f-4275-83f5-325e068f5120 response_code = 204 uri = /eip-gateways
32182024-12-18T20:00:33.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43026
32192024-12-18T20:00:33.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43026 req_id = bb53e908-3609-4fdf-a7ca-de564eaf38dc response_code = 200 uri = /vpc-routes
32202024-12-18T20:00:33.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51728
32212024-12-18T20:00:33.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51728 req_id = 1667a021-9f3f-49e5-aed2-f4b10a89d75f response_code = 200 uri = /v2p
32222024-12-18T20:00:33.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49673 req_id = 014a83dc-bedd-4c9a-9ebe-df69a3dfe1c5 response_code = 204 uri = /vpc-routes
32232024-12-18T20:00:33.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47790
32242024-12-18T20:00:33.920ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32252024-12-18T20:00:33.964ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32262024-12-18T20:00:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47790 req_id = 1901e868-e4bc-4455-bf49-37063003485f response_code = 204 uri = /switch-ports
32272024-12-18T20:00:34.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48767
32282024-12-18T20:00:34.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} }
32292024-12-18T20:00:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43026 req_id = ef16a053-ca52-4985-8550-66709d6b160f response_code = 204 uri = /eip-gateways
32302024-12-18T20:00:34.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32312024-12-18T20:00:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47790 req_id = b40eebac-3781-4b97-88bd-591232133ef6 response_code = 200 uri = /network-bootstore-config
32322024-12-18T20:00:34.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43026 req_id = 53244cf1-8161-42f1-8c79-47eec88c0370 response_code = 204 uri = /vpc-routes
32332024-12-18T20:00:34.075ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32342024-12-18T20:00:34.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62464
32352024-12-18T20:00:34.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62464 req_id = 54b3cd92-4383-4cec-a30c-df15439d3145 response_code = 200 uri = /vpc-routes
32362024-12-18T20:00:34.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41854
32372024-12-18T20:00:34.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41854 req_id = c50cc452-8434-483e-9341-4e626dc64582 response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652/state
32382024-12-18T20:00:34.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48767 req_id = a73c5eac-6729-45ff-972d-12ae910418f1 response_code = 204 uri = /switch-ports
32392024-12-18T20:00:34.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48767 req_id = 17e6de1d-98db-414e-a5bd-b31a109c6568 response_code = 200 uri = /network-bootstore-config
32402024-12-18T20:00:34.177ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} }
32412024-12-18T20:00:34.177ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62464 req_id = e9d39f11-df23-454f-b0e0-00814f299026 response_code = 204 uri = /eip-gateways
32422024-12-18T20:00:34.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62464 req_id = c8cc4ed4-41d1-482c-9544-917e6ddbffa7 response_code = 204 uri = /vpc-routes
32432024-12-18T20:00:34.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46422
32442024-12-18T20:00:34.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46422 req_id = 99dca07c-dd29-4d22-8405-75a45765781a response_code = 200 uri = /v2p
32452024-12-18T20:00:34.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36795
32462024-12-18T20:00:34.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
32472024-12-18T20:00:34.334ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
32482024-12-18T20:00:34.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96277 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36795 req_id = c420f20d-de36-4b4d-ae9a-4c24ee4b657a response_code = 204 uri = /switch-ports
32492024-12-18T20:00:34.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36795 req_id = 23dbae4e-5e93-41c7-bb62-7d9b93cc407a response_code = 200 uri = /network-bootstore-config
32502024-12-18T20:00:41.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50189
32512024-12-18T20:00:41.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50189 req_id = d29e1997-aafa-48d1-93a2-cb23479589ab response_code = 200 uri = /vmms/847fe597-97bb-407a-9591-7b5a43309652/state
32522024-12-18T20:00:41.211ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-18T20:00:41.211023444Z } file = sled-agent/src/instance.rs:780 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32532024-12-18T20:00:41.211ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T20:00:41.211023444Z } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32542024-12-18T20:00:41.211ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-18T20:00:41.211023444Z }, migration_in: None, migration_out: None }
32552024-12-18T20:00:41.268ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-18T20:00:41.267983276Z } file = sled-agent/src/instance.rs:780 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32562024-12-18T20:00:41.268ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-18T20:00:41.267983276Z } propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32572024-12-18T20:00:41.268ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32582024-12-18T20:00:41.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32592024-12-18T20:00:41.268ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
32602024-12-18T20:00:41.268ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/78cecaad-9cc8-4539-b5e4-05d09d011c2d/debug/bundle/zone", "/pool/int/f1657089-065e-4651-a353-e5d94949a179/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2bc4bf5f-823b-4004-892a-72049fa9dd2d/crypt/debug", "/pool/ext/4585f13b-0248-4d0e-a56e-45d95198a363/crypt/debug", "/pool/ext/b2f32ee3-8e81-4491-bdc2-61259f84a111/crypt/debug", "/pool/ext/415023e8-4b60-4f50-85ce-5d337214083f/crypt/debug", "/pool/ext/3943ba64-84f5-40ee-94de-ef33bd94d891/crypt/debug", "/pool/ext/c3612c32-5622-4a67-9ae3-29c036aec45e/crypt/debug", "/pool/ext/32d90d79-6a5e-46e0-95ee-42ca469395c6/crypt/debug", "/pool/ext/e3387fe8-8213-4b32-a12a-44f87d74c32a/crypt/debug", "/pool/ext/96909843-abb5-4785-acdb-8d286f18ea02/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652
32612024-12-18T20:00:42.005ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652", bundle_id: 86ac5950-68bb-4c2c-8a71-738e68a3e5f1 }, time_created: 2024-12-18T20:00:41.269124230Z, version: 0, cause: TerminatedInstance }
32622024-12-18T20:00:42.005ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_847fe597-97bb-407a-9591-7b5a43309652 file = sled-agent/src/instance.rs:1032 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32632024-12-18T20:00:43.817ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32642024-12-18T20:00:43.832ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(837593), kind: System }
32652024-12-18T20:00:43.832ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(837593), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
32662024-12-18T20:00:43.833ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T20:00:43.833339190Z }, migration_in: None, migration_out: None }
32672024-12-18T20:00:43.917ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-18T20:00:43.833339190Z }, migration_in: None, migration_out: None }
32682024-12-18T20:00:43.921ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = d1132c69-1a7c-4cdf-9c74-13d3bbf109f5 propolis_id = 847fe597-97bb-407a-9591-7b5a43309652
32692024-12-18T20:00:44.551ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8097 local_addr = [fd00:1122:3344:101::1]:64949 method = GET remote_addr = [fd00:1122:3344:101::d]:34806 req_id = 30cabaa0-6b60-4f06-ac4a-70fb2e333888 response_code = 200 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 uri = /58ee29db-9185-4216-97e8-559d204ec1d2
32702024-12-18T20:00:44.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38962
32712024-12-18T20:00:44.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38962 req_id = 94c78ee6-f3e9-493d-bdc0-1cc9382421a0 response_code = 200 uri = /vpc-routes
32722024-12-18T20:00:44.984ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {bfb560e0-429e-473e-a379-6f8c8b01bf4b: {10.151.2.175: {2653237a-012f-4e42-a58d-0c5bef0b2a48}, 10.151.2.176: {2653237a-012f-4e42-a58d-0c5bef0b2a48}}} }
32732024-12-18T20:00:44.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38962 req_id = f0a2ff0d-3ad7-4be5-8271-41089bf2cd78 response_code = 204 uri = /eip-gateways
32742024-12-18T20:00:44.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38962 req_id = eeb9595f-5ccb-45c1-a6c1-bf26560198ca response_code = 204 uri = /vpc-routes
32752024-12-18T20:00:45.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56805
32762024-12-18T20:00:45.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56805 req_id = 8886cb6d-b781-427f-95f4-4f3ad188b904 response_code = 200 uri = /v2p
32772024-12-18T20:00:47.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47757
32782024-12-18T20:00:47.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47757 req_id = ae337106-1fdf-4752-8c09-d010ba6100b7 response_code = 200 uri = /v2p
32792024-12-18T20:00:47.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56498
32802024-12-18T20:00:47.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56498 req_id = a3579925-6615-4aeb-80ff-7412bdb4b414 response_code = 200 uri = /vpc-routes
32812024-12-18T20:00:47.239ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
32822024-12-18T20:00:47.239ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2
32832024-12-18T20:00:47.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56498 req_id = 4196efa0-30e0-4957-b036-6d99d3ebfa40 response_code = 204 uri = /eip-gateways
32842024-12-18T20:00:47.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56498 req_id = 287f1ab7-fa47-4a88-8214-f4f3605aa6f7 response_code = 204 uri = /vpc-routes
32852024-12-18T20:00:49.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63605
32862024-12-18T20:00:49.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63605 req_id = ba3eb2e6-01b4-4543-8761-bae170f072c9 response_code = 200 uri = /vpc-routes
32872024-12-18T20:00:49.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = 58ee29db-9185-4216-97e8-559d204ec1d2 values = ExternalIpGatewayMap { mappings: {} }
32882024-12-18T20:00:49.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63605 req_id = 61879c88-4cab-46b4-a039-29f894020ef4 response_code = 204 uri = /eip-gateways
32892024-12-18T20:00:49.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63605 req_id = 4c8f80b7-dbba-4ed3-89ca-0e0032a575a0 response_code = 204 uri = /vpc-routes