Max level shown:
1 [ Dec 7 00:45:49 Enabled. ]
2 [ Dec 7 00:45:49 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 7 00:45:49 Method "start" exited with status 0. ]
4 [ Dec 7 00:45:49 Rereading configuration. ]
5 [ Dec 7 00:45:49 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-07T00:45:49.165ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-07T00:45:49.165ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-07T00:45:49.217ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-07T00:45:49.217ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-07T00:45:49.332ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-07T00:45:49.341ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-07T00:45:49.350ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-07T00:45:49.950ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-07T00:45:50.097ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-07T00:45:50.097ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-07T00:45:50.098ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-07T00:45:50.098ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-07T00:45:50.098ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-12-07T00:45:50.098ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212024-12-07T00:45:50.101ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-07T00:45:50.101ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-07T00:45:50.101ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-07T00:45:50.101ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-07T00:45:50.101ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-07T00:45:50.101ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-07T00:45:50.101ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-07T00:45:50.101ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-07T00:45:50.101ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-07T00:45:50.112ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-07T00:45:50.112ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool)
322024-12-07T00:45:50.213ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal }
332024-12-07T00:45:50.700ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-07T00:45:50.700ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-07T00:45:50.700ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-07T00:45:50.700ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-07T00:45:50.700ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
382024-12-07T00:45:50.700ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
392024-12-07T00:45:50.700ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
402024-12-07T00:45:50.700ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
412024-12-07T00:45:50.700ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
422024-12-07T00:45:50.700ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
432024-12-07T00:45:50.709ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
442024-12-07T00:45:50.709ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e4c25222-749e-4d77-939a-4c6435801dea (zpool)
452024-12-07T00:45:50.797ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal }
462024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
472024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
482024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
492024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
502024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
522024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
532024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
542024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
552024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
562024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
582024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
592024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
602024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
612024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
622024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
632024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
642024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
652024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
662024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
672024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
682024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
692024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
702024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
712024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
722024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
732024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
742024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
752024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
762024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
772024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
782024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
792024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
802024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812024-12-07T00:45:51.262ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
822024-12-07T00:45:51.262ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
832024-12-07T00:45:51.262ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
842024-12-07T00:45:51.262ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
852024-12-07T00:45:51.262ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
862024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
872024-12-07T00:45:51.263ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
882024-12-07T00:45:51.263ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
892024-12-07T00:45:51.263ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902024-12-07T00:45:51.263ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
912024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
922024-12-07T00:45:51.263ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
932024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942024-12-07T00:45:51.263ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
952024-12-07T00:45:51.263ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
962024-12-07T00:45:51.263ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
972024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
982024-12-07T00:45:51.263ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
992024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002024-12-07T00:45:51.263ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
1012024-12-07T00:45:51.263ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1022024-12-07T00:45:51.263ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1032024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1042024-12-07T00:45:51.263ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1052024-12-07T00:45:51.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1062024-12-07T00:45:51.263ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1072024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1102024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1112024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1122024-12-07T00:45:51.263ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1132024-12-07T00:45:51.263ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1142024-12-07T00:45:51.263ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1152024-12-07T00:45:51.274ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1162024-12-07T00:45:51.274ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4214, tv_nsec: 531199839 } time_to_next_cleanup = 599.999932418s
1172024-12-07T00:45:51.274ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1182024-12-07T00:45:51.274ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1192024-12-07T00:45:51.274ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/sled-agent-request.json file = common/src/ledger.rs:188
1202024-12-07T00:45:51.277ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/sled-agent-request.json file = common/src/ledger.rs:188
1212024-12-07T00:45:51.277ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1222024-12-07T00:45:51.279ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1232024-12-07T00:45:51.280ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1242024-12-07T00:45:51.280ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1252024-12-07T00:45:51.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1262024-12-07T00:45:51.280ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1272024-12-07T00:45:51.280ZINFOSledAgent (RSS): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/rss-started.marker file = common/src/ledger.rs:188
1282024-12-07T00:45:51.280ZINFOSledAgent (RSS): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/rss-started.marker file = common/src/ledger.rs:188
1292024-12-07T00:45:51.280ZINFOSledAgent (RSS): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1302024-12-07T00:45:51.280ZINFOSledAgent (RSS): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1312024-12-07T00:45:51.280ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1322024-12-07T00:45:51.280ZINFOSledAgent (RSS): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1332024-12-07T00:45:51.280ZINFOSledAgent (RSS): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1342024-12-07T00:45:51.280ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1352024-12-07T00:45:51.280ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1362024-12-07T00:45:51.280ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1372024-12-07T00:45:51.280ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1382024-12-07T00:45:51.280ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1392024-12-07T00:45:51.280ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-12-07T00:45:51.280ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1412024-12-07T00:45:51.280ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1422024-12-07T00:45:51.280ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 (sled), rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1432024-12-07T00:45:51.282ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1442024-12-07T00:45:51.282ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1452024-12-07T00:45:51.286ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1462024-12-07T00:45:51.292ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1472024-12-07T00:45:51.292ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1482024-12-07T00:45:51.297ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1492024-12-07T00:45:51.297ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1502024-12-07T00:45:51.297ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:33360
1512024-12-07T00:45:51.297ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 (sled), rack_id: 667e4910-296b-4cf9-a580-7c638e7aa45a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1522024-12-07T00:45:51.297ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1532024-12-07T00:45:51.297ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1542024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1552024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1562024-12-07T00:45:51.297ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1572024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1582024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1592024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1602024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1612024-12-07T00:45:51.297ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1622024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1632024-12-07T00:45:51.297ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1642024-12-07T00:45:51.297ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1652024-12-07T00:45:51.313ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1662024-12-07T00:45:51.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1672024-12-07T00:45:51.351ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1682024-12-07T00:45:51.375ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
1692024-12-07T00:45:51.375ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1702024-12-07T00:45:51.375ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
1712024-12-07T00:45:51.375ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1722024-12-07T00:45:51.378ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 87.852574ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "92306b96-4bd5-4b77-9267-23c5f941af8b", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "92306b96-4bd5-4b77-9267-23c5f941af8b" } file = clients/ddm-admin-client/src/lib.rs:177
1732024-12-07T00:45:51.388ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_f4878337-f259-4e9a-8a59-7c0e80a9fc4d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1742024-12-07T00:45:51.411ZINFOSledAgent: successfully created encrypted zvol: name="oxi_f4878337-f259-4e9a-8a59-7c0e80a9fc4d/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1752024-12-07T00:45:51.411ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_f4878337-f259-4e9a-8a59-7c0e80a9fc4d/swap" file = sled-agent/src/swap_device.rs:96
1762024-12-07T00:45:51.416ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
1772024-12-07T00:45:51.416ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1782024-12-07T00:45:51.416ZINFOSledAgent (BackingFs): Ensuring dataset oxi_f4878337-f259-4e9a-8a59-7c0e80a9fc4d/backing/fmd file = sled-agent/src/backing_fs.rs:138
1792024-12-07T00:45:51.466ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-07T00:45:51.467ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 93.872312ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "71811a54-47ec-4235-8869-1a172315401b", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "71811a54-47ec-4235-8869-1a172315401b" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-07T00:45:51.501ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1822024-12-07T00:45:51.561ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-12-07T00:45:51.562ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.640275ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c97b2743-8f23-4d01-aa87-2b6fe93fe2f1", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c97b2743-8f23-4d01-aa87-2b6fe93fe2f1" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-12-07T00:45:51.666ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1852024-12-07T00:45:51.666ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 129.059045ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "71d1f049-c8f5-4def-aff3-e5e9145d5b2a", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "71d1f049-c8f5-4def-aff3-e5e9145d5b2a" } file = clients/ddm-admin-client/src/lib.rs:177
1862024-12-07T00:45:51.719ZINFOSledAgent (BackingFs): Mounting oxi_f4878337-f259-4e9a-8a59-7c0e80a9fc4d/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1872024-12-07T00:45:51.732ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1882024-12-07T00:45:51.732ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1892024-12-07T00:45:51.732ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1902024-12-07T00:45:51.732ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1912024-12-07T00:45:51.797ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1922024-12-07T00:45:51.797ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.299128ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ef61f5cd-304c-4150-8bb7-9178123dcd45", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ef61f5cd-304c-4150-8bb7-9178123dcd45" } file = clients/ddm-admin-client/src/lib.rs:177
1932024-12-07T00:45:51.977ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1942024-12-07T00:45:51.978ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 214.709534ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e1852e07-fc7c-432f-ae58-66b1f12702d9", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e1852e07-fc7c-432f-ae58-66b1f12702d9" } file = clients/ddm-admin-client/src/lib.rs:177
1952024-12-07T00:45:52.193ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1962024-12-07T00:45:52.194ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 230.938506ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b643b39c-5734-4529-a1e7-298b0972edab", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:51 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b643b39c-5734-4529-a1e7-298b0972edab" } file = clients/ddm-admin-client/src/lib.rs:177
1972024-12-07T00:45:52.426ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1982024-12-07T00:45:52.426ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 218.602834ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9cca4c3-0339-4876-ba1c-97f36f8e0593", "content-length": "124", "date": "Sat, 07 Dec 2024 00:45:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9cca4c3-0339-4876-ba1c-97f36f8e0593" } file = clients/ddm-admin-client/src/lib.rs:177
1992024-12-07T00:45:52.480ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2002024-12-07T00:45:52.485ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:51308 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2012024-12-07T00:45:52.486ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2022024-12-07T00:45:52.486ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:51308 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2032024-12-07T00:45:52.487ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 298.090336ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2042024-12-07T00:45:52.488ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2052024-12-07T00:45:52.488ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2062024-12-07T00:45:52.488ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2072024-12-07T00:45:52.488ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2082024-12-07T00:45:52.647ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2092024-12-07T00:45:52.786ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 655.599ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2102024-12-07T00:45:53.443ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.31650021s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2112024-12-07T00:45:54.761ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.743797762s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2122024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2132024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2142024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2152024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2162024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2172024-12-07T00:45:55.008ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2182024-12-07T00:45:55.010ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2192024-12-07T00:45:55.012ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2202024-12-07T00:45:55.012ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='630ff20a-bc24-4456-8b29-6fa2f4364e40'/> <propval type="astring" name="rack_id" value='667e4910-296b-4cf9-a580-7c638e7aa45a'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe06:c98e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='667e4910-296b-4cf9-a580-7c638e7aa45a'/> <propval type="astring" name="sled_id" value='e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3'/> <propval type="astring" name="rack_uuid" value='667e4910-296b-4cf9-a580-7c638e7aa45a'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3'/> <propval type="astring" name="rack_uuid" value='667e4910-296b-4cf9-a580-7c638e7aa45a'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2212024-12-07T00:45:55.012ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2222024-12-07T00:45:55.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 59.298977ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-12-07T00:45:55.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 72.163543ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-07T00:45:55.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 113.497075ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-07T00:45:55.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 443.33703ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262024-12-07T00:45:56.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.062848687s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-07T00:45:57.507ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.326915003s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2282024-12-07T00:45:57.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 602.057024ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2292024-12-07T00:45:58.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 586.483244ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2302024-12-07T00:45:59.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.093500744s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2312024-12-07T00:46:00.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 679.340953ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2322024-12-07T00:46:01.314ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/nexus.rs:527 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2332024-12-07T00:46:01.343ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2342024-12-07T00:46:01.344ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2352024-12-07T00:46:01.345ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2362024-12-07T00:46:01.345ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2372024-12-07T00:46:01.345ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2382024-12-07T00:46:01.345ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2392024-12-07T00:46:01.345ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2402024-12-07T00:46:01.345ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2412024-12-07T00:46:01.345ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2422024-12-07T00:46:01.345ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2432024-12-07T00:46:01.345ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:33360
2442024-12-07T00:46:01.536ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2452024-12-07T00:46:01.536ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2462024-12-07T00:46:01.541ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2472024-12-07T00:46:01.541ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2482024-12-07T00:46:01.541ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2492024-12-07T00:46:01.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42879
2502024-12-07T00:46:01.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2512024-12-07T00:46:01.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2522024-12-07T00:46:01.801ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:188
2532024-12-07T00:46:01.801ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:188
2542024-12-07T00:46:01.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42879 req_id = 0aade2ec-0c5a-4bbf-819b-a685f8f2fc90 response_code = 200 uri = /inventory
2552024-12-07T00:46:01.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47615
2562024-12-07T00:46:01.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47615 req_id = 02cdaffe-d345-40d5-bccc-cd833e9c0553 response_code = 200 uri = /sled-role
2572024-12-07T00:46:01.837ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 7.764560151s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2582024-12-07T00:46:01.863ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 4cce197c-1138-404f-b40b-c1b57d0319ba (physical_disk), pool_id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e5840551-5e32-459e-a854-0cc496c82aab (physical_disk), pool_id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 9d8b76ae-7f85-4371-a47f-d4cb2f72b65e (physical_disk), pool_id: 37290789-dec6-48b1-bd11-48c109977543 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ca638f13-add7-4e1d-8e1e-9f3f8324823b (physical_disk), pool_id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ed371430-4522-46e5-8968-2d53494ee7ef (physical_disk), pool_id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 133da2c8-fceb-40a3-8d77-478bfa9c05a1 (physical_disk), pool_id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: dd5b6b10-7e33-4a2f-8b77-8765bb235744 (physical_disk), pool_id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ec775f34-2251-4ef7-be26-04167e6f03a1 (physical_disk), pool_id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 022b417b-b807-4ad4-8b07-ae898db8d886 (physical_disk), pool_id: 9d33808d-deca-4533-adee-690176030136 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2592024-12-07T00:46:01.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37438
2602024-12-07T00:46:01.864ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2612024-12-07T00:46:01.864ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 4cce197c-1138-404f-b40b-c1b57d0319ba (physical_disk), pool_id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e5840551-5e32-459e-a854-0cc496c82aab (physical_disk), pool_id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 9d8b76ae-7f85-4371-a47f-d4cb2f72b65e (physical_disk), pool_id: 37290789-dec6-48b1-bd11-48c109977543 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ca638f13-add7-4e1d-8e1e-9f3f8324823b (physical_disk), pool_id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: ed371430-4522-46e5-8968-2d53494ee7ef (physical_disk), pool_id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 133da2c8-fceb-40a3-8d77-478bfa9c05a1 (physical_disk), pool_id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: dd5b6b10-7e33-4a2f-8b77-8765bb235744 (physical_disk), pool_id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ec775f34-2251-4ef7-be26-04167e6f03a1 (physical_disk), pool_id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 022b417b-b807-4ad4-8b07-ae898db8d886 (physical_disk), pool_id: 9d33808d-deca-4533-adee-690176030136 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2622024-12-07T00:46:01.864ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2632024-12-07T00:46:01.864ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2642024-12-07T00:46:01.864ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2652024-12-07T00:46:01.864ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2662024-12-07T00:46:01.864ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2672024-12-07T00:46:01.864ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2682024-12-07T00:46:01.864ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2692024-12-07T00:46:02.048ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2702024-12-07T00:46:02.048ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool)
2712024-12-07T00:46:02.507ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2722024-12-07T00:46:02.507ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12616434255163811797 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2732024-12-07T00:46:02.508ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10720078698359092692 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2742024-12-07T00:46:02.964ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
2752024-12-07T00:46:02.993ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }
2762024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2772024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2782024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2792024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2802024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2812024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2822024-12-07T00:46:03.002ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2832024-12-07T00:46:03.037ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2842024-12-07T00:46:03.045ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone file = sled-storage/src/dataset.rs:303
2852024-12-07T00:46:03.215ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f file = sled-storage/src/dataset.rs:389
2862024-12-07T00:46:03.222ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2872024-12-07T00:46:03.222ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2882024-12-07T00:46:03.222ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2892024-12-07T00:46:03.222ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2902024-12-07T00:46:03.222ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2912024-12-07T00:46:03.232ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2922024-12-07T00:46:03.232ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool)
2932024-12-07T00:46:03.327ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }
2942024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2952024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2962024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2972024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2982024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2992024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
3002024-12-07T00:46:03.335ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3012024-12-07T00:46:03.370ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3022024-12-07T00:46:03.378ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone file = sled-storage/src/dataset.rs:303
3032024-12-07T00:46:03.510ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
3042024-12-07T00:46:03.552ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 file = sled-storage/src/dataset.rs:389
3052024-12-07T00:46:03.560ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3062024-12-07T00:46:03.560ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3072024-12-07T00:46:03.560ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3082024-12-07T00:46:03.560ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3092024-12-07T00:46:03.560ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3102024-12-07T00:46:03.570ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3112024-12-07T00:46:03.570ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 37290789-dec6-48b1-bd11-48c109977543 (zpool)
3122024-12-07T00:46:03.661ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }
3132024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3142024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3152024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3162024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3172024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3182024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3192024-12-07T00:46:03.669ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3202024-12-07T00:46:03.707ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3212024-12-07T00:46:03.714ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone file = sled-storage/src/dataset.rs:303
3222024-12-07T00:46:03.883ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_37290789-dec6-48b1-bd11-48c109977543 file = sled-storage/src/dataset.rs:389
3232024-12-07T00:46:03.891ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3242024-12-07T00:46:03.891ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3252024-12-07T00:46:03.891ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3262024-12-07T00:46:03.891ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3272024-12-07T00:46:03.891ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3282024-12-07T00:46:03.902ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3292024-12-07T00:46:03.902ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool)
3302024-12-07T00:46:04.008ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }
3312024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3322024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3332024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3342024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3352024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3362024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3372024-12-07T00:46:04.016ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3382024-12-07T00:46:04.050ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3392024-12-07T00:46:04.058ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone file = sled-storage/src/dataset.rs:303
3402024-12-07T00:46:04.233ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b file = sled-storage/src/dataset.rs:389
3412024-12-07T00:46:04.241ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3422024-12-07T00:46:04.241ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3432024-12-07T00:46:04.241ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3442024-12-07T00:46:04.241ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3452024-12-07T00:46:04.241ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3462024-12-07T00:46:04.250ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3472024-12-07T00:46:04.250ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool)
3482024-12-07T00:46:04.343ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }
3492024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3502024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3512024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3522024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3532024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3542024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3552024-12-07T00:46:04.350ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3562024-12-07T00:46:04.385ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3572024-12-07T00:46:04.392ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone file = sled-storage/src/dataset.rs:303
3582024-12-07T00:46:04.515ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
3592024-12-07T00:46:04.555ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14 file = sled-storage/src/dataset.rs:389
3602024-12-07T00:46:04.562ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3612024-12-07T00:46:04.562ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3622024-12-07T00:46:04.562ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3632024-12-07T00:46:04.562ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3642024-12-07T00:46:04.562ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3652024-12-07T00:46:04.571ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3662024-12-07T00:46:04.571ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool)
3672024-12-07T00:46:04.667ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }
3682024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3692024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3702024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3712024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3722024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3732024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3742024-12-07T00:46:04.675ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3752024-12-07T00:46:04.710ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3762024-12-07T00:46:04.718ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone file = sled-storage/src/dataset.rs:303
3772024-12-07T00:46:04.899ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c file = sled-storage/src/dataset.rs:389
3782024-12-07T00:46:04.907ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3792024-12-07T00:46:04.907ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3802024-12-07T00:46:04.907ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3812024-12-07T00:46:04.907ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3822024-12-07T00:46:04.907ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3832024-12-07T00:46:04.917ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3842024-12-07T00:46:04.917ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool)
3852024-12-07T00:46:05.014ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }
3862024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3872024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3882024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3892024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3902024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3912024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3922024-12-07T00:46:05.022ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3932024-12-07T00:46:05.058ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3942024-12-07T00:46:05.066ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone file = sled-storage/src/dataset.rs:303
3952024-12-07T00:46:05.249ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c file = sled-storage/src/dataset.rs:389
3962024-12-07T00:46:05.257ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3972024-12-07T00:46:05.257ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3982024-12-07T00:46:05.257ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3992024-12-07T00:46:05.257ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4002024-12-07T00:46:05.257ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
4012024-12-07T00:46:05.266ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
4022024-12-07T00:46:05.266ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool)
4032024-12-07T00:46:05.362ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }
4042024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4052024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4062024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4072024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4082024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4092024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4102024-12-07T00:46:05.370ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4112024-12-07T00:46:05.405ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4122024-12-07T00:46:05.413ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/zone file = sled-storage/src/dataset.rs:303
4132024-12-07T00:46:05.517ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4142024-12-07T00:46:05.594ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7 file = sled-storage/src/dataset.rs:389
4152024-12-07T00:46:05.602ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4162024-12-07T00:46:05.602ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4172024-12-07T00:46:05.602ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4182024-12-07T00:46:05.602ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4192024-12-07T00:46:05.602ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4202024-12-07T00:46:05.612ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4212024-12-07T00:46:05.612ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9d33808d-deca-4533-adee-690176030136 (zpool)
4222024-12-07T00:46:05.708ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }
4232024-12-07T00:46:05.716ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4242024-12-07T00:46:05.716ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4252024-12-07T00:46:05.716ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4262024-12-07T00:46:05.716ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4272024-12-07T00:46:05.716ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4282024-12-07T00:46:05.717ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4292024-12-07T00:46:05.717ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4302024-12-07T00:46:05.752ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4312024-12-07T00:46:05.761ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9d33808d-deca-4533-adee-690176030136/crypt/zone file = sled-storage/src/dataset.rs:303
4322024-12-07T00:46:05.938ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9d33808d-deca-4533-adee-690176030136 file = sled-storage/src/dataset.rs:389
4332024-12-07T00:46:05.946ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4342024-12-07T00:46:05.946ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4352024-12-07T00:46:05.946ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362024-12-07T00:46:05.947ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4878337-f259-4e9a-8a59-7c0e80a9fc4d (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e4c25222-749e-4d77-939a-4c6435801dea (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4372024-12-07T00:46:05.947ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4382024-12-07T00:46:05.947ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4392024-12-07T00:46:05.947ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4402024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4412024-12-07T00:46:05.947ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4422024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4432024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4442024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4452024-12-07T00:46:05.947ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4462024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4472024-12-07T00:46:05.947ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4482024-12-07T00:46:05.947ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4492024-12-07T00:46:05.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4083837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37438 req_id = 142a2c14-6bd2-4874-9f73-a856b58e6fd6 response_code = 200 uri = /omicron-physical-disks
4502024-12-07T00:46:05.979ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00da4bbe-406f-415e-a205-c36f0efde883 (dataset): DatasetConfig { id: 00da4bbe-406f-415e-a205-c36f0efde883 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03a9f120-2114-4509-80a6-e3614c20118e (dataset): DatasetConfig { id: 03a9f120-2114-4509-80a6-e3614c20118e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05180ef0-aacb-4c32-9d70-1114c149e533 (dataset): DatasetConfig { id: 05180ef0-aacb-4c32-9d70-1114c149e533 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 078bca85-1841-4dfe-8f99-9e3e1abab662 (dataset): DatasetConfig { id: 078bca85-1841-4dfe-8f99-9e3e1abab662 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f1de45-8e0f-4d4c-a151-a07a6c44da65 (dataset): DatasetConfig { id: 08f1de45-8e0f-4d4c-a151-a07a6c44da65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11c3a7d2-f4d0-4846-932f-981610609e86 (dataset): DatasetConfig { id: 11c3a7d2-f4d0-4846-932f-981610609e86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e43d0b-74be-4dbd-880b-297afc45dcca (dataset): DatasetConfig { id: 12e43d0b-74be-4dbd-880b-297afc45dcca (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1539f0cf-c121-4d20-ad20-bd6f97798ea6 (dataset): DatasetConfig { id: 1539f0cf-c121-4d20-ad20-bd6f97798ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ecbc58f-574f-4802-af20-e6e162f0790b (dataset): DatasetConfig { id: 1ecbc58f-574f-4802-af20-e6e162f0790b (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1eed05f8-a149-4be4-9fb7-0da0052fd2e5 (dataset): DatasetConfig { id: 1eed05f8-a149-4be4-9fb7-0da0052fd2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fd88b05-5ae9-4886-99d1-efadddb2578a (dataset): DatasetConfig { id: 1fd88b05-5ae9-4886-99d1-efadddb2578a (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27769ff3-6c19-4e6f-80ac-6be0dacd61c0 (dataset): DatasetConfig { id: 27769ff3-6c19-4e6f-80ac-6be0dacd61c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f83132d-414d-4933-a9a4-ed05b62cd64c (dataset): DatasetConfig { id: 2f83132d-414d-4933-a9a4-ed05b62cd64c (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30f9e0b8-4621-4305-9ec1-6c5d23fb86de (dataset): DatasetConfig { id: 30f9e0b8-4621-4305-9ec1-6c5d23fb86de (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 311cfa26-9535-4342-8b57-6fee9d5ef5f1 (dataset): DatasetConfig { id: 311cfa26-9535-4342-8b57-6fee9d5ef5f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3561d8a0-0a0f-4edf-8462-0de0d7d24df9 (dataset): DatasetConfig { id: 3561d8a0-0a0f-4edf-8462-0de0d7d24df9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a8c107d-f7b3-4ec6-a10f-e5c32f025fd4 (dataset): DatasetConfig { id: 3a8c107d-f7b3-4ec6-a10f-e5c32f025fd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ba909a7-87e2-471b-84ba-35538d926cc1 (dataset): DatasetConfig { id: 3ba909a7-87e2-471b-84ba-35538d926cc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ec2f7e7-f960-461a-8bb1-5017dab5877c (dataset): DatasetConfig { id: 3ec2f7e7-f960-461a-8bb1-5017dab5877c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42dfb142-6177-44ef-8e72-66740eba62e2 (dataset): DatasetConfig { id: 42dfb142-6177-44ef-8e72-66740eba62e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46e34e6a-94dd-475e-b430-864cdc4162dc (dataset): DatasetConfig { id: 46e34e6a-94dd-475e-b430-864cdc4162dc (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471e855a-7b3e-4284-86cd-0ef5d878592d (dataset): DatasetConfig { id: 471e855a-7b3e-4284-86cd-0ef5d878592d (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6605fa-7260-4fc9-ae65-c0995e4cee5a (dataset): DatasetConfig { id: 4b6605fa-7260-4fc9-ae65-c0995e4cee5a (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c7ebc51-4200-4bea-b5b5-7da548b79cb3 (dataset): DatasetConfig { id: 4c7ebc51-4200-4bea-b5b5-7da548b79cb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c88540a-672f-4b39-9932-82bac9999792 (dataset): DatasetConfig { id: 4c88540a-672f-4b39-9932-82bac9999792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4c94dc-c48d-4317-b9e5-8efed1d963ed (dataset): DatasetConfig { id: 4e4c94dc-c48d-4317-b9e5-8efed1d963ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 519065ab-051a-4ee5-8376-4cee1c154926 (dataset): DatasetConfig { id: 519065ab-051a-4ee5-8376-4cee1c154926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67a67ada-6fa8-462d-8491-490c3d0b444d (dataset): DatasetConfig { id: 67a67ada-6fa8-462d-8491-490c3d0b444d (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a318512-ae27-4928-b259-fb46240fef25 (dataset): DatasetConfig { id: 6a318512-ae27-4928-b259-fb46240fef25 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bd25c8d-0f0a-461a-8f7a-920a70fbe4f6 (dataset): DatasetConfig { id: 6bd25c8d-0f0a-461a-8f7a-920a70fbe4f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74e10e16-82f1-4f76-89f2-d1e48b2fd403 (dataset): DatasetConfig { id: 74e10e16-82f1-4f76-89f2-d1e48b2fd403 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b1ca976-f3a8-4b97-a98f-f31d97da9c49 (dataset): DatasetConfig { id: 7b1ca976-f3a8-4b97-a98f-f31d97da9c49 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7da1d720-5fc9-4b0a-a124-b645f4f36f92 (dataset): DatasetConfig { id: 7da1d720-5fc9-4b0a-a124-b645f4f36f92 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82d7d924-7f0a-4b55-8c94-7b8d06da7bec (dataset): DatasetConfig { id: 82d7d924-7f0a-4b55-8c94-7b8d06da7bec (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8634200c-e71f-4d1f-9c5c-d095496a8ccc (dataset): DatasetConfig { id: 8634200c-e71f-4d1f-9c5c-d095496a8ccc (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a6a8699-ae4f-41f6-b408-38dfeb716e6d (dataset): DatasetConfig { id: 8a6a8699-ae4f-41f6-b408-38dfeb716e6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8edf538a-6c70-4db3-b22d-835caf21aa80 (dataset): DatasetConfig { id: 8edf538a-6c70-4db3-b22d-835caf21aa80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fbf5f25-bfb1-4859-80a4-a254657321b8 (dataset): DatasetConfig { id: 8fbf5f25-bfb1-4859-80a4-a254657321b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 951718aa-cb90-40da-9588-27195ddd80d4 (dataset): DatasetConfig { id: 951718aa-cb90-40da-9588-27195ddd80d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 958896eb-a6ee-4f65-8889-196f833e662f (dataset): DatasetConfig { id: 958896eb-a6ee-4f65-8889-196f833e662f (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d477cdd-aac6-4ccf-b3dc-13effb367d16 (dataset): DatasetConfig { id: 9d477cdd-aac6-4ccf-b3dc-13effb367d16 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6b44039-748b-4c41-9964-2d3e961096a1 (dataset): DatasetConfig { id: a6b44039-748b-4c41-9964-2d3e961096a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9256f48-23b2-4c0a-9264-989e7444799a (dataset): DatasetConfig { id: a9256f48-23b2-4c0a-9264-989e7444799a (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac6b908b-37fe-403e-9511-5facadee9bc3 (dataset): DatasetConfig { id: ac6b908b-37fe-403e-9511-5facadee9bc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad684380-4153-4d7b-8f18-917a0dea60c8 (dataset): DatasetConfig { id: ad684380-4153-4d7b-8f18-917a0dea60c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b00f5731-636f-491a-b7e1-934e2625e519 (dataset): DatasetConfig { id: b00f5731-636f-491a-b7e1-934e2625e519 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0866fd1-ebce-484a-9204-9614a60d208b (dataset): DatasetConfig { id: b0866fd1-ebce-484a-9204-9614a60d208b (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3e4603c-ea58-4a63-bf05-9a6ae6f58e84 (dataset): DatasetConfig { id: b3e4603c-ea58-4a63-bf05-9a6ae6f58e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6ef82fb-0d92-414d-a7a3-c9e42c8c40fd (dataset): DatasetConfig { id: b6ef82fb-0d92-414d-a7a3-c9e42c8c40fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bec1075b-345a-4afc-a6ac-d3135ba23e07 (dataset): DatasetConfig { id: bec1075b-345a-4afc-a6ac-d3135ba23e07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c069bc82-2048-4048-99a8-2efcaa20860f (dataset): DatasetConfig { id: c069bc82-2048-4048-99a8-2efcaa20860f (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0f52b8f-a8b9-48f3-b37e-774b3a107155 (dataset): DatasetConfig { id: c0f52b8f-a8b9-48f3-b37e-774b3a107155 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5d721c1-48a2-4cbf-97c4-70c63f6e3efd (dataset): DatasetConfig { id: c5d721c1-48a2-4cbf-97c4-70c63f6e3efd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb76bfb6-a870-4903-bc5d-2dc27602702e (dataset): DatasetConfig { id: cb76bfb6-a870-4903-bc5d-2dc27602702e (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cda63194-347b-47bb-b2a7-cf4774fb8d3d (dataset): DatasetConfig { id: cda63194-347b-47bb-b2a7-cf4774fb8d3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec96289-2d49-4747-8244-b703822467af (dataset): DatasetConfig { id: cec96289-2d49-4747-8244-b703822467af (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1989863-ba73-4928-98d1-536908b94a9c (dataset): DatasetConfig { id: d1989863-ba73-4928-98d1-536908b94a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2df036f-0fac-4aa7-ac6e-f6d2a92d5538 (dataset): DatasetConfig { id: d2df036f-0fac-4aa7-ac6e-f6d2a92d5538 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d6b662-f94a-4109-83c1-416c3761e4a2 (dataset): DatasetConfig { id: d6d6b662-f94a-4109-83c1-416c3761e4a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7403126-5b03-4593-bca3-72e49ed8f6a6 (dataset): DatasetConfig { id: d7403126-5b03-4593-bca3-72e49ed8f6a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de8a7a54-a88f-481f-8f55-3990dc172421 (dataset): DatasetConfig { id: de8a7a54-a88f-481f-8f55-3990dc172421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7532195-ac2a-4479-bebd-7788b4a23539 (dataset): DatasetConfig { id: e7532195-ac2a-4479-bebd-7788b4a23539 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb76bfb2-b58b-4166-a66c-8847f10fbf18 (dataset): DatasetConfig { id: eb76bfb2-b58b-4166-a66c-8847f10fbf18 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eec8f1e0-32c8-4891-a501-027326125ff5 (dataset): DatasetConfig { id: eec8f1e0-32c8-4891-a501-027326125ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f489eaf5-a0c2-4d33-920c-c27bd83c92d8 (dataset): DatasetConfig { id: f489eaf5-a0c2-4d33-920c-c27bd83c92d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4d1c123-ce26-4c54-b27c-c4699ecf8574 (dataset): DatasetConfig { id: f4d1c123-ce26-4c54-b27c-c4699ecf8574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4512024-12-07T00:46:05.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50981
4522024-12-07T00:46:05.979ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4532024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00da4bbe-406f-415e-a205-c36f0efde883 (dataset): DatasetConfig { id: 00da4bbe-406f-415e-a205-c36f0efde883 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 03a9f120-2114-4509-80a6-e3614c20118e (dataset): DatasetConfig { id: 03a9f120-2114-4509-80a6-e3614c20118e (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05180ef0-aacb-4c32-9d70-1114c149e533 (dataset): DatasetConfig { id: 05180ef0-aacb-4c32-9d70-1114c149e533 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 078bca85-1841-4dfe-8f99-9e3e1abab662 (dataset): DatasetConfig { id: 078bca85-1841-4dfe-8f99-9e3e1abab662 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f1de45-8e0f-4d4c-a151-a07a6c44da65 (dataset): DatasetConfig { id: 08f1de45-8e0f-4d4c-a151-a07a6c44da65 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 11c3a7d2-f4d0-4846-932f-981610609e86 (dataset): DatasetConfig { id: 11c3a7d2-f4d0-4846-932f-981610609e86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 12e43d0b-74be-4dbd-880b-297afc45dcca (dataset): DatasetConfig { id: 12e43d0b-74be-4dbd-880b-297afc45dcca (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1539f0cf-c121-4d20-ad20-bd6f97798ea6 (dataset): DatasetConfig { id: 1539f0cf-c121-4d20-ad20-bd6f97798ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ecbc58f-574f-4802-af20-e6e162f0790b (dataset): DatasetConfig { id: 1ecbc58f-574f-4802-af20-e6e162f0790b (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1eed05f8-a149-4be4-9fb7-0da0052fd2e5 (dataset): DatasetConfig { id: 1eed05f8-a149-4be4-9fb7-0da0052fd2e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1fd88b05-5ae9-4886-99d1-efadddb2578a (dataset): DatasetConfig { id: 1fd88b05-5ae9-4886-99d1-efadddb2578a (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27769ff3-6c19-4e6f-80ac-6be0dacd61c0 (dataset): DatasetConfig { id: 27769ff3-6c19-4e6f-80ac-6be0dacd61c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f83132d-414d-4933-a9a4-ed05b62cd64c (dataset): DatasetConfig { id: 2f83132d-414d-4933-a9a4-ed05b62cd64c (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 30f9e0b8-4621-4305-9ec1-6c5d23fb86de (dataset): DatasetConfig { id: 30f9e0b8-4621-4305-9ec1-6c5d23fb86de (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 311cfa26-9535-4342-8b57-6fee9d5ef5f1 (dataset): DatasetConfig { id: 311cfa26-9535-4342-8b57-6fee9d5ef5f1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3561d8a0-0a0f-4edf-8462-0de0d7d24df9 (dataset): DatasetConfig { id: 3561d8a0-0a0f-4edf-8462-0de0d7d24df9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a8c107d-f7b3-4ec6-a10f-e5c32f025fd4 (dataset): DatasetConfig { id: 3a8c107d-f7b3-4ec6-a10f-e5c32f025fd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ba909a7-87e2-471b-84ba-35538d926cc1 (dataset): DatasetConfig { id: 3ba909a7-87e2-471b-84ba-35538d926cc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ec2f7e7-f960-461a-8bb1-5017dab5877c (dataset): DatasetConfig { id: 3ec2f7e7-f960-461a-8bb1-5017dab5877c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42dfb142-6177-44ef-8e72-66740eba62e2 (dataset): DatasetConfig { id: 42dfb142-6177-44ef-8e72-66740eba62e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46e34e6a-94dd-475e-b430-864cdc4162dc (dataset): DatasetConfig { id: 46e34e6a-94dd-475e-b430-864cdc4162dc (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 471e855a-7b3e-4284-86cd-0ef5d878592d (dataset): DatasetConfig { id: 471e855a-7b3e-4284-86cd-0ef5d878592d (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b6605fa-7260-4fc9-ae65-c0995e4cee5a (dataset): DatasetConfig { id: 4b6605fa-7260-4fc9-ae65-c0995e4cee5a (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c7ebc51-4200-4bea-b5b5-7da548b79cb3 (dataset): DatasetConfig { id: 4c7ebc51-4200-4bea-b5b5-7da548b79cb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c88540a-672f-4b39-9932-82bac9999792 (dataset): DatasetConfig { id: 4c88540a-672f-4b39-9932-82bac9999792 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4c94dc-c48d-4317-b9e5-8efed1d963ed (dataset): DatasetConfig { id: 4e4c94dc-c48d-4317-b9e5-8efed1d963ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 519065ab-051a-4ee5-8376-4cee1c154926 (dataset): DatasetConfig { id: 519065ab-051a-4ee5-8376-4cee1c154926 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 67a67ada-6fa8-462d-8491-490c3d0b444d (dataset): DatasetConfig { id: 67a67ada-6fa8-462d-8491-490c3d0b444d (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6a318512-ae27-4928-b259-fb46240fef25 (dataset): DatasetConfig { id: 6a318512-ae27-4928-b259-fb46240fef25 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bd25c8d-0f0a-461a-8f7a-920a70fbe4f6 (dataset): DatasetConfig { id: 6bd25c8d-0f0a-461a-8f7a-920a70fbe4f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74e10e16-82f1-4f76-89f2-d1e48b2fd403 (dataset): DatasetConfig { id: 74e10e16-82f1-4f76-89f2-d1e48b2fd403 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b1ca976-f3a8-4b97-a98f-f31d97da9c49 (dataset): DatasetConfig { id: 7b1ca976-f3a8-4b97-a98f-f31d97da9c49 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7da1d720-5fc9-4b0a-a124-b645f4f36f92 (dataset): DatasetConfig { id: 7da1d720-5fc9-4b0a-a124-b645f4f36f92 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82d7d924-7f0a-4b55-8c94-7b8d06da7bec (dataset): DatasetConfig { id: 82d7d924-7f0a-4b55-8c94-7b8d06da7bec (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8634200c-e71f-4d1f-9c5c-d095496a8ccc (dataset): DatasetConfig { id: 8634200c-e71f-4d1f-9c5c-d095496a8ccc (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8a6a8699-ae4f-41f6-b408-38dfeb716e6d (dataset): DatasetConfig { id: 8a6a8699-ae4f-41f6-b408-38dfeb716e6d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8edf538a-6c70-4db3-b22d-835caf21aa80 (dataset): DatasetConfig { id: 8edf538a-6c70-4db3-b22d-835caf21aa80 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8fbf5f25-bfb1-4859-80a4-a254657321b8 (dataset): DatasetConfig { id: 8fbf5f25-bfb1-4859-80a4-a254657321b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 951718aa-cb90-40da-9588-27195ddd80d4 (dataset): DatasetConfig { id: 951718aa-cb90-40da-9588-27195ddd80d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 958896eb-a6ee-4f65-8889-196f833e662f (dataset): DatasetConfig { id: 958896eb-a6ee-4f65-8889-196f833e662f (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d477cdd-aac6-4ccf-b3dc-13effb367d16 (dataset): DatasetConfig { id: 9d477cdd-aac6-4ccf-b3dc-13effb367d16 (dataset), name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a6b44039-748b-4c41-9964-2d3e961096a1 (dataset): DatasetConfig { id: a6b44039-748b-4c41-9964-2d3e961096a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9256f48-23b2-4c0a-9264-989e7444799a (dataset): DatasetConfig { id: a9256f48-23b2-4c0a-9264-989e7444799a (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac6b908b-37fe-403e-9511-5facadee9bc3 (dataset): DatasetConfig { id: ac6b908b-37fe-403e-9511-5facadee9bc3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ad684380-4153-4d7b-8f18-917a0dea60c8 (dataset): DatasetConfig { id: ad684380-4153-4d7b-8f18-917a0dea60c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b00f5731-636f-491a-b7e1-934e2625e519 (dataset): DatasetConfig { id: b00f5731-636f-491a-b7e1-934e2625e519 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b0866fd1-ebce-484a-9204-9614a60d208b (dataset): DatasetConfig { id: b0866fd1-ebce-484a-9204-9614a60d208b (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3e4603c-ea58-4a63-bf05-9a6ae6f58e84 (dataset): DatasetConfig { id: b3e4603c-ea58-4a63-bf05-9a6ae6f58e84 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6ef82fb-0d92-414d-a7a3-c9e42c8c40fd (dataset): DatasetConfig { id: b6ef82fb-0d92-414d-a7a3-c9e42c8c40fd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bec1075b-345a-4afc-a6ac-d3135ba23e07 (dataset): DatasetConfig { id: bec1075b-345a-4afc-a6ac-d3135ba23e07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c069bc82-2048-4048-99a8-2efcaa20860f (dataset): DatasetConfig { id: c069bc82-2048-4048-99a8-2efcaa20860f (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0f52b8f-a8b9-48f3-b37e-774b3a107155 (dataset): DatasetConfig { id: c0f52b8f-a8b9-48f3-b37e-774b3a107155 (dataset), name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5d721c1-48a2-4cbf-97c4-70c63f6e3efd (dataset): DatasetConfig { id: c5d721c1-48a2-4cbf-97c4-70c63f6e3efd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cb76bfb6-a870-4903-bc5d-2dc27602702e (dataset): DatasetConfig { id: cb76bfb6-a870-4903-bc5d-2dc27602702e (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cda63194-347b-47bb-b2a7-cf4774fb8d3d (dataset): DatasetConfig { id: cda63194-347b-47bb-b2a7-cf4774fb8d3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cec96289-2d49-4747-8244-b703822467af (dataset): DatasetConfig { id: cec96289-2d49-4747-8244-b703822467af (dataset), name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1989863-ba73-4928-98d1-536908b94a9c (dataset): DatasetConfig { id: d1989863-ba73-4928-98d1-536908b94a9c (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2df036f-0fac-4aa7-ac6e-f6d2a92d5538 (dataset): DatasetConfig { id: d2df036f-0fac-4aa7-ac6e-f6d2a92d5538 (dataset), name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d6b662-f94a-4109-83c1-416c3761e4a2 (dataset): DatasetConfig { id: d6d6b662-f94a-4109-83c1-416c3761e4a2 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d7403126-5b03-4593-bca3-72e49ed8f6a6 (dataset): DatasetConfig { id: d7403126-5b03-4593-bca3-72e49ed8f6a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de8a7a54-a88f-481f-8f55-3990dc172421 (dataset): DatasetConfig { id: de8a7a54-a88f-481f-8f55-3990dc172421 (dataset), name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7532195-ac2a-4479-bebd-7788b4a23539 (dataset): DatasetConfig { id: e7532195-ac2a-4479-bebd-7788b4a23539 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb76bfb2-b58b-4166-a66c-8847f10fbf18 (dataset): DatasetConfig { id: eb76bfb2-b58b-4166-a66c-8847f10fbf18 (dataset), name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eec8f1e0-32c8-4891-a501-027326125ff5 (dataset): DatasetConfig { id: eec8f1e0-32c8-4891-a501-027326125ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f489eaf5-a0c2-4d33-920c-c27bd83c92d8 (dataset): DatasetConfig { id: f489eaf5-a0c2-4d33-920c-c27bd83c92d8 (dataset), name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f4d1c123-ce26-4c54-b27c-c4699ecf8574 (dataset): DatasetConfig { id: f4d1c123-ce26-4c54-b27c-c4699ecf8574 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4542024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4552024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4562024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4572024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4582024-12-07T00:46:05.979ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crucible" } file = sled-storage/src/manager.rs:1331
4592024-12-07T00:46:06.068ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4602024-12-07T00:46:06.068ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9d33808d-deca-4533-adee-690176030136/crypt/zone/oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6"), full_name: "oxp_9d33808d-deca-4533-adee-690176030136/crypt/zone/oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6" } file = sled-storage/src/manager.rs:1331
4612024-12-07T00:46:06.166ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-12-07T00:46:06.166ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crucible" } file = sled-storage/src/manager.rs:1331
4632024-12-07T00:46:06.253ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-12-07T00:46:06.253ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone"), full_name: "oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone" } file = sled-storage/src/manager.rs:1331
4652024-12-07T00:46:06.321ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-12-07T00:46:06.321ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7" } file = sled-storage/src/manager.rs:1331
4672024-12-07T00:46:06.420ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-12-07T00:46:06.420ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4692024-12-07T00:46:06.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-12-07T00:46:06.510ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9d33808d-deca-4533-adee-690176030136/crypt/debug"), full_name: "oxp_9d33808d-deca-4533-adee-690176030136/crypt/debug" } file = sled-storage/src/manager.rs:1331
4712024-12-07T00:46:06.522ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4722024-12-07T00:46:06.578ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732024-12-07T00:46:06.578ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4742024-12-07T00:46:06.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752024-12-07T00:46:06.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/debug"), full_name: "oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762024-12-07T00:46:06.738ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772024-12-07T00:46:06.738ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crucible" } file = sled-storage/src/manager.rs:1331
4782024-12-07T00:46:06.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792024-12-07T00:46:06.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76" } file = sled-storage/src/manager.rs:1331
4802024-12-07T00:46:06.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812024-12-07T00:46:06.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728" } file = sled-storage/src/manager.rs:1331
4822024-12-07T00:46:07.025ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832024-12-07T00:46:07.025ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4842024-12-07T00:46:07.114ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-12-07T00:46:07.114ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone/oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c"), full_name: "oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone/oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c" } file = sled-storage/src/manager.rs:1331
4862024-12-07T00:46:07.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-12-07T00:46:07.213ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crucible" } file = sled-storage/src/manager.rs:1331
4882024-12-07T00:46:07.299ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-12-07T00:46:07.299ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/debug"), full_name: "oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/debug" } file = sled-storage/src/manager.rs:1331
4902024-12-07T00:46:07.366ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-12-07T00:46:07.366ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/zone"), full_name: "oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/zone" } file = sled-storage/src/manager.rs:1331
4922024-12-07T00:46:07.433ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-12-07T00:46:07.434ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone/oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone/oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd" } file = sled-storage/src/manager.rs:1331
4942024-12-07T00:46:07.525ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
4952024-12-07T00:46:07.531ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962024-12-07T00:46:07.531ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4972024-12-07T00:46:07.620ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982024-12-07T00:46:07.620ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/zone/oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f"), full_name: "oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/zone/oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f" } file = sled-storage/src/manager.rs:1331
4992024-12-07T00:46:07.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002024-12-07T00:46:07.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone" } file = sled-storage/src/manager.rs:1331
5012024-12-07T00:46:07.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022024-12-07T00:46:07.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5" } file = sled-storage/src/manager.rs:1331
5032024-12-07T00:46:07.887ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042024-12-07T00:46:07.887ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crucible" } file = sled-storage/src/manager.rs:1331
5052024-12-07T00:46:07.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062024-12-07T00:46:07.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone" } file = sled-storage/src/manager.rs:1331
5072024-12-07T00:46:08.043ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082024-12-07T00:46:08.043ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3" } file = sled-storage/src/manager.rs:1331
5092024-12-07T00:46:08.144ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5102024-12-07T00:46:08.144ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53" } file = sled-storage/src/manager.rs:1331
5112024-12-07T00:46:08.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-12-07T00:46:08.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone" } file = sled-storage/src/manager.rs:1331
5132024-12-07T00:46:08.313ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-12-07T00:46:08.313ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5152024-12-07T00:46:08.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-12-07T00:46:08.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd" } file = sled-storage/src/manager.rs:1331
5172024-12-07T00:46:08.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-12-07T00:46:08.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone" } file = sled-storage/src/manager.rs:1331
5192024-12-07T00:46:08.527ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5202024-12-07T00:46:08.571ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212024-12-07T00:46:08.571ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850" } file = sled-storage/src/manager.rs:1331
5222024-12-07T00:46:08.669ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232024-12-07T00:46:08.669ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae" } file = sled-storage/src/manager.rs:1331
5242024-12-07T00:46:08.767ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252024-12-07T00:46:08.767ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone/oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/zone/oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0" } file = sled-storage/src/manager.rs:1331
5262024-12-07T00:46:08.870ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272024-12-07T00:46:08.871ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5282024-12-07T00:46:08.960ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5292024-12-07T00:46:08.960ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5302024-12-07T00:46:09.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5312024-12-07T00:46:09.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee" } file = sled-storage/src/manager.rs:1331
5322024-12-07T00:46:09.146ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5332024-12-07T00:46:09.146ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9d33808d-deca-4533-adee-690176030136/crypt/zone"), full_name: "oxp_9d33808d-deca-4533-adee-690176030136/crypt/zone" } file = sled-storage/src/manager.rs:1331
5342024-12-07T00:46:09.215ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-12-07T00:46:09.215ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c" } file = sled-storage/src/manager.rs:1331
5362024-12-07T00:46:09.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5372024-12-07T00:46:09.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721" } file = sled-storage/src/manager.rs:1331
5382024-12-07T00:46:09.410ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5392024-12-07T00:46:09.410ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0" } file = sled-storage/src/manager.rs:1331
5402024-12-07T00:46:09.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5412024-12-07T00:46:09.507ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/debug"), full_name: "oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/debug" } file = sled-storage/src/manager.rs:1331
5422024-12-07T00:46:09.531ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5432024-12-07T00:46:09.574ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-12-07T00:46:09.574ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f" } file = sled-storage/src/manager.rs:1331
5452024-12-07T00:46:09.606ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.246369904s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5462024-12-07T00:46:09.670ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5472024-12-07T00:46:09.670ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1" } file = sled-storage/src/manager.rs:1331
5482024-12-07T00:46:09.768ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5492024-12-07T00:46:09.768ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5502024-12-07T00:46:09.858ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512024-12-07T00:46:09.858ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/debug"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/debug" } file = sled-storage/src/manager.rs:1331
5522024-12-07T00:46:09.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532024-12-07T00:46:09.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b" } file = sled-storage/src/manager.rs:1331
5542024-12-07T00:46:10.028ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552024-12-07T00:46:10.028ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/zone/oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5" } file = sled-storage/src/manager.rs:1331
5562024-12-07T00:46:10.125ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5572024-12-07T00:46:10.125ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/debug"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5582024-12-07T00:46:10.211ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5592024-12-07T00:46:10.211ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9d33808d-deca-4533-adee-690176030136/crypt/zone/oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633"), full_name: "oxp_9d33808d-deca-4533-adee-690176030136/crypt/zone/oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633" } file = sled-storage/src/manager.rs:1331
5602024-12-07T00:46:10.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-07T00:46:10.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crucible" } file = sled-storage/src/manager.rs:1331
5622024-12-07T00:46:10.402ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-12-07T00:46:10.402ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone" } file = sled-storage/src/manager.rs:1331
5642024-12-07T00:46:10.472ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-07T00:46:10.472ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone/oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b"), full_name: "oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/zone/oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b" } file = sled-storage/src/manager.rs:1331
5662024-12-07T00:46:10.534ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5672024-12-07T00:46:10.572ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5682024-12-07T00:46:10.572ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/debug"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/debug" } file = sled-storage/src/manager.rs:1331
5692024-12-07T00:46:10.642ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5702024-12-07T00:46:10.642ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/debug"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/debug" } file = sled-storage/src/manager.rs:1331
5712024-12-07T00:46:10.711ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5722024-12-07T00:46:10.712ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/zone/oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a" } file = sled-storage/src/manager.rs:1331
5732024-12-07T00:46:10.811ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5742024-12-07T00:46:10.811ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9d33808d-deca-4533-adee-690176030136/crucible" } file = sled-storage/src/manager.rs:1331
5752024-12-07T00:46:10.909ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5762024-12-07T00:46:10.909ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone/oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882" } file = sled-storage/src/manager.rs:1331
5772024-12-07T00:46:11.012ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5782024-12-07T00:46:11.012ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crucible" } file = sled-storage/src/manager.rs:1331
5792024-12-07T00:46:11.101ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5802024-12-07T00:46:11.101ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/zone/oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64" } file = sled-storage/src/manager.rs:1331
5812024-12-07T00:46:11.203ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-07T00:46:11.203ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5832024-12-07T00:46:11.296ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-07T00:46:11.296ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/zone"), full_name: "oxp_37290789-dec6-48b1-bd11-48c109977543/crypt/zone" } file = sled-storage/src/manager.rs:1331
5852024-12-07T00:46:11.314ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13389991434031076328 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5862024-12-07T00:46:11.315ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2461058191275250544 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
5872024-12-07T00:46:11.331ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5882024-12-07T00:46:11.331ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5892024-12-07T00:46:11.336ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5902024-12-07T00:46:11.336ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5912024-12-07T00:46:11.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922024-12-07T00:46:11.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible" } file = sled-storage/src/manager.rs:1331
5932024-12-07T00:46:11.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5942024-12-07T00:46:11.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5952024-12-07T00:46:11.493ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5962024-12-07T00:46:11.493ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5972024-12-07T00:46:11.533ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5982024-12-07T00:46:11.534ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5992024-12-07T00:46:11.537ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6002024-12-07T00:46:11.582ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012024-12-07T00:46:11.582ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/debug"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/debug" } file = sled-storage/src/manager.rs:1331
6022024-12-07T00:46:11.585ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6032024-12-07T00:46:11.585ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6042024-12-07T00:46:11.604ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6052024-12-07T00:46:11.604ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6062024-12-07T00:46:11.657ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6072024-12-07T00:46:11.657ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
6082024-12-07T00:46:11.680ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6092024-12-07T00:46:11.680ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6102024-12-07T00:46:11.752ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6112024-12-07T00:46:11.752ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec"), full_name: "oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/zone/oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec" } file = sled-storage/src/manager.rs:1331
6122024-12-07T00:46:11.771ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6132024-12-07T00:46:11.771ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6142024-12-07T00:46:11.813ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6152024-12-07T00:46:11.813ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/nexus.rs:527 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6162024-12-07T00:46:11.850ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6172024-12-07T00:46:11.850ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6182024-12-07T00:46:11.851ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6192024-12-07T00:46:11.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5871966 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50981 req_id = 78175e8d-41dc-460b-a05d-46c4fb77c2d9 response_code = 200 uri = /datasets
6202024-12-07T00:46:11.854ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6212024-12-07T00:46:11.854ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6222024-12-07T00:46:11.854ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6232024-12-07T00:46:11.854ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6242024-12-07T00:46:11.890ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: fd72061d-6779-40de-8011-8e899981c9e7 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: be11a55e-cb67-4535-ad44-b9a4d4586728 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6252024-12-07T00:46:11.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60533
6262024-12-07T00:46:11.891ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6272024-12-07T00:46:11.891ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6282024-12-07T00:46:11.907ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6292024-12-07T00:46:11.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6302024-12-07T00:46:11.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6312024-12-07T00:46:11.957ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6322024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6332024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6342024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6352024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6362024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6372024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6382024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6392024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6402024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6412024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6422024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6432024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6442024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6452024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6462024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6472024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6482024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6492024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6502024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6512024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6522024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6532024-12-07T00:46:11.957ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6542024-12-07T00:46:11.957ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6552024-12-07T00:46:11.957ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6562024-12-07T00:46:11.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6572024-12-07T00:46:11.990ZINFOSledAgent (ServiceManager): No ledger in /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:188
6582024-12-07T00:46:11.990ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:188
6592024-12-07T00:46:11.990ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6602024-12-07T00:46:12.037ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6612024-12-07T00:46:12.037ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6622024-12-07T00:46:12.037ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6632024-12-07T00:46:12.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b file = illumos-utils/src/zone.rs:325
6642024-12-07T00:46:12.092ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728 file = illumos-utils/src/zone.rs:325
6652024-12-07T00:46:12.096ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7 file = illumos-utils/src/zone.rs:325
6662024-12-07T00:46:12.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b file = illumos-utils/src/zone.rs:363
6672024-12-07T00:46:12.113ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728 file = illumos-utils/src/zone.rs:363
6682024-12-07T00:46:12.118ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7 file = illumos-utils/src/zone.rs:363
6692024-12-07T00:46:12.510ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12616434255163811797 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6702024-12-07T00:46:12.510ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10720078698359092692 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6712024-12-07T00:46:12.539ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3) file = sled-agent/src/probe_manager.rs:231 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
6722024-12-07T00:46:13.726ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6732024-12-07T00:46:13.726ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6742024-12-07T00:46:13.726ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6752024-12-07T00:46:14.212ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762024-12-07T00:46:14.693ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772024-12-07T00:46:14.693ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6782024-12-07T00:46:14.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 36.916645ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6792024-12-07T00:46:14.701ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802024-12-07T00:46:14.702ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6812024-12-07T00:46:14.706ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6822024-12-07T00:46:14.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 138.770819ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6832024-12-07T00:46:14.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 33.661167ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6842024-12-07T00:46:14.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 39.886283ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6852024-12-07T00:46:14.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 65.213052ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6862024-12-07T00:46:14.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 116.770765ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6872024-12-07T00:46:14.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 188.7517ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6882024-12-07T00:46:15.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 104.328225ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6892024-12-07T00:46:15.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 182.998122ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6902024-12-07T00:46:15.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 315.555628ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6912024-12-07T00:46:15.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 560.933038ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6922024-12-07T00:46:15.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 479.173918ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6932024-12-07T00:46:15.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 927.87961ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6942024-12-07T00:46:15.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 1.069867582s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6952024-12-07T00:46:15.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 639.581851ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6962024-12-07T00:46:16.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 877.361053ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
6972024-12-07T00:46:16.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 589.494353ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
6982024-12-07T00:46:16.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 1.04073415s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
6992024-12-07T00:46:17.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 560.800117ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
7002024-12-07T00:46:17.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 1.42786853s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
7012024-12-07T00:46:17.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 669.287945ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
7022024-12-07T00:46:17.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7") failed: Property not found. retry in 1.470329489s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
7032024-12-07T00:46:18.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 948.132052ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
7042024-12-07T00:46:18.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 838.866054ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
7052024-12-07T00:46:19.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b") failed: Property not found. retry in 1.137264375s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
7062024-12-07T00:46:19.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728") failed: Property not found. retry in 915.489001ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
7072024-12-07T00:46:20.535ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_5661fac0-67b8-45f8-869a-67dd3e21bd0b
7082024-12-07T00:46:20.535ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_be11a55e-cb67-4535-ad44-b9a4d4586728
7092024-12-07T00:46:20.535ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_fd72061d-6779-40de-8011-8e899981c9e7
7102024-12-07T00:46:20.535ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7112024-12-07T00:46:20.535ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7122024-12-07T00:46:20.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8644758 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60533 req_id = d0315a14-1995-4dbf-a644-121904ce4063 response_code = 204 uri = /omicron-zones
7132024-12-07T00:46:20.537ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7142024-12-07T00:46:20.592ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7152024-12-07T00:46:20.622ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 121.792516ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7162024-12-07T00:46:20.761ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7172024-12-07T00:46:20.809ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7182024-12-07T00:46:20.809ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7192024-12-07T00:46:20.842ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7202024-12-07T00:46:20.843ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7212024-12-07T00:46:20.843ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7222024-12-07T00:46:20.874ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: fd72061d-6779-40de-8011-8e899981c9e7 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: be11a55e-cb67-4535-ad44-b9a4d4586728 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 83dd33bf-63d5-469c-89b8-0090fc119721 (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 24e3e3c6-6abd-44ac-b07a-67f36e1b4c25, kind: Service { id: 83dd33bf-63d5-469c-89b8-0090fc119721 }, name: Name("ntp-83dd33bf-63d5-469c-89b8-0090fc119721"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7232024-12-07T00:46:20.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61419
7242024-12-07T00:46:20.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7252024-12-07T00:46:20.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7262024-12-07T00:46:20.912ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7272024-12-07T00:46:20.912ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7282024-12-07T00:46:20.948ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7292024-12-07T00:46:20.948ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7302024-12-07T00:46:20.981ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7312024-12-07T00:46:20.981ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
7322024-12-07T00:46:20.982ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
7332024-12-07T00:46:20.982ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7342024-12-07T00:46:20.993ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7352024-12-07T00:46:21.025ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7362024-12-07T00:46:21.026ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7372024-12-07T00:46:21.026ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7382024-12-07T00:46:21.055ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 238, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7392024-12-07T00:46:21.055ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7402024-12-07T00:46:21.056ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7412024-12-07T00:46:21.056ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7422024-12-07T00:46:21.056ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7432024-12-07T00:46:21.056ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7442024-12-07T00:46:21.081ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721 file = illumos-utils/src/zone.rs:325
7452024-12-07T00:46:21.099ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721 file = illumos-utils/src/zone.rs:363
7462024-12-07T00:46:21.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13389991434031076328 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7472024-12-07T00:46:21.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2461058191275250544 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7482024-12-07T00:46:21.722ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7492024-12-07T00:46:21.722ZINFOSledAgent (ServiceManager): Booting oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7502024-12-07T00:46:21.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 62.193721ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7512024-12-07T00:46:21.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 52.712009ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7522024-12-07T00:46:22.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 156.29701ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7532024-12-07T00:46:22.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 550.765256ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7542024-12-07T00:46:22.512ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12616434255163811797 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7552024-12-07T00:46:22.512ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10720078698359092692 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7562024-12-07T00:46:22.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 1.04881293s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7572024-12-07T00:46:23.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 1.053137884s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7582024-12-07T00:46:24.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 699.983641ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7592024-12-07T00:46:25.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 645.787309ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7602024-12-07T00:46:26.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721") failed: Property not found. retry in 580.043478ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7612024-12-07T00:46:26.843ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721
7622024-12-07T00:46:26.843ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632024-12-07T00:46:26.843ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642024-12-07T00:46:26.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5969581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61419 req_id = 861dd2d1-1779-4da3-8bc2-b5863c822d64 response_code = 204 uri = /omicron-zones
7652024-12-07T00:46:26.846ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7662024-12-07T00:46:26.876ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7672024-12-07T00:46:26.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46200
7682024-12-07T00:46:26.885ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7692024-12-07T00:46:26.885ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8962 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46200 req_id = 8c18b295-b74e-46a2-8e97-652fd7091a82 response_code = 500 uri = /timesync
7702024-12-07T00:46:26.887ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7712024-12-07T00:46:26.994ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7722024-12-07T00:46:26.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39609
7732024-12-07T00:46:31.006ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7742024-12-07T00:46:31.006ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4011176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39609 req_id = 12a32785-79d8-4081-b295-5e7ec4ac6fb9 response_code = 500 uri = /timesync
7752024-12-07T00:46:31.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15164086064834631142 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7762024-12-07T00:46:31.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9421055956099660685 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7772024-12-07T00:46:31.008ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5689490617795558630 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7782024-12-07T00:46:31.009ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7792024-12-07T00:46:31.210ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7802024-12-07T00:46:31.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54271
7812024-12-07T00:46:31.218ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7822024-12-07T00:46:31.218ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8588 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54271 req_id = 1753b318-181c-4477-b9d2-b8b266c8b3e2 response_code = 500 uri = /timesync
7832024-12-07T00:46:31.221ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7842024-12-07T00:46:31.319ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13389991434031076328 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7852024-12-07T00:46:31.319ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2461058191275250544 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7862024-12-07T00:46:31.405ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7872024-12-07T00:46:31.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64149
7882024-12-07T00:46:35.414ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_83dd33bf-63d5-469c-89b8-0090fc119721': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7892024-12-07T00:46:35.414ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008450 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64149 req_id = f528c41a-4a98-4382-8a7f-a5f13469d6dc response_code = 500 uri = /timesync
7902024-12-07T00:46:35.416ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12616434255163811797 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7912024-12-07T00:46:35.416ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10720078698359092692 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
7922024-12-07T00:46:35.417ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7932024-12-07T00:46:35.626ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7942024-12-07T00:46:35.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42335
7952024-12-07T00:46:35.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8822 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42335 req_id = dc9a7dda-1198-43cb-b6d5-70e81e887b32 response_code = 200 uri = /timesync
7962024-12-07T00:46:35.637ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.029780313 } file = sled-agent/src/rack_setup/service.rs:743
7972024-12-07T00:46:35.637ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7982024-12-07T00:46:35.805ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7992024-12-07T00:46:35.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41530
8002024-12-07T00:46:35.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41530 req_id = 07d0c129-2e61-4e2c-a752-b0eb5086d77d response_code = 200 uri = /timesync
8012024-12-07T00:46:35.815ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.02929927 } file = sled-agent/src/rack_setup/service.rs:743
8022024-12-07T00:46:35.815ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8032024-12-07T00:46:36.186ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8042024-12-07T00:46:36.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36152
8052024-12-07T00:46:36.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20676 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36152 req_id = edfd305a-5564-46fc-ae58-fa304b4502d3 response_code = 200 uri = /timesync
8062024-12-07T00:46:36.211ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1754848266, ip_addr: 104.152.220.10, stratum: 3, ref_time: 1733532395.0378337, correction: 0.026879799 } file = sled-agent/src/rack_setup/service.rs:743
8072024-12-07T00:46:36.211ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8082024-12-07T00:46:36.241ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: fd72061d-6779-40de-8011-8e899981c9e7 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: be11a55e-cb67-4535-ad44-b9a4d4586728 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 83dd33bf-63d5-469c-89b8-0090fc119721 (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 24e3e3c6-6abd-44ac-b07a-67f36e1b4c25, kind: Service { id: 83dd33bf-63d5-469c-89b8-0090fc119721 }, name: Name("ntp-83dd33bf-63d5-469c-89b8-0090fc119721"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1e766793-b675-48d5-b60e-8c57f234f66f (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } } } }, OmicronZoneConfig { id: 7b88a190-b92e-4019-bea8-d22c40d8551c (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1e4134a0-b9c4-4e22-910b-2429957984cd (service), filesystem_pool: Some(ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External } } } }, OmicronZoneConfig { id: 1481398d-7590-4d5f-a745-059b743b42d0 (service), filesystem_pool: Some(ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8092024-12-07T00:46:36.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53172
8102024-12-07T00:46:36.242ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8112024-12-07T00:46:36.242ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8122024-12-07T00:46:36.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8132024-12-07T00:46:36.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8142024-12-07T00:46:36.317ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8152024-12-07T00:46:36.317ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8162024-12-07T00:46:36.350ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e766793-b675-48d5-b60e-8c57f234f66f, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8172024-12-07T00:46:36.350ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e766793-b675-48d5-b60e-8c57f234f66f, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, responder: ... }
8182024-12-07T00:46:36.382ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b88a190-b92e-4019-bea8-d22c40d8551c, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8192024-12-07T00:46:36.382ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b88a190-b92e-4019-bea8-d22c40d8551c, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8202024-12-07T00:46:36.414ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8212024-12-07T00:46:36.415ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8222024-12-07T00:46:36.445ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e4134a0-b9c4-4e22-910b-2429957984cd, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8232024-12-07T00:46:36.445ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e4134a0-b9c4-4e22-910b-2429957984cd, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, responder: ... }
8242024-12-07T00:46:36.480ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1481398d-7590-4d5f-a745-059b743b42d0, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8252024-12-07T00:46:36.480ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1481398d-7590-4d5f-a745-059b743b42d0, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8262024-12-07T00:46:36.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8272024-12-07T00:46:36.512ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
8282024-12-07T00:46:36.513ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
8292024-12-07T00:46:36.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8302024-12-07T00:46:36.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8312024-12-07T00:46:36.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8322024-12-07T00:46:36.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8332024-12-07T00:46:36.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8342024-12-07T00:46:36.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8352024-12-07T00:46:36.690ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c file = illumos-utils/src/zone.rs:325
8362024-12-07T00:46:36.694ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f file = illumos-utils/src/zone.rs:325
8372024-12-07T00:46:36.698ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0 file = illumos-utils/src/zone.rs:325
8382024-12-07T00:46:36.702ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd file = illumos-utils/src/zone.rs:325
8392024-12-07T00:46:36.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 file = illumos-utils/src/zone.rs:325
8402024-12-07T00:46:36.712ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c file = illumos-utils/src/zone.rs:363
8412024-12-07T00:46:36.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f file = illumos-utils/src/zone.rs:363
8422024-12-07T00:46:36.721ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0 file = illumos-utils/src/zone.rs:363
8432024-12-07T00:46:36.726ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd file = illumos-utils/src/zone.rs:363
8442024-12-07T00:46:36.730ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 file = illumos-utils/src/zone.rs:363
8452024-12-07T00:46:37.898ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 159.930454ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
8462024-12-07T00:46:39.468ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7b88a190-b92e-4019-bea8-d22c40d8551c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8472024-12-07T00:46:39.468ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='92a6da63-3b7e-4ef0-bfe9-6bc6299305e0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8482024-12-07T00:46:39.468ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8492024-12-07T00:46:39.474ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1e766793-b675-48d5-b60e-8c57f234f66f'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8502024-12-07T00:46:39.474ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8512024-12-07T00:46:39.478ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1481398d-7590-4d5f-a745-059b743b42d0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8522024-12-07T00:46:39.478ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8532024-12-07T00:46:39.483ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8542024-12-07T00:46:39.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 46.682635ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8552024-12-07T00:46:39.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 32.114527ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8562024-12-07T00:46:39.621ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1e4134a0-b9c4-4e22-910b-2429957984cd'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8572024-12-07T00:46:39.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 28.017062ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8582024-12-07T00:46:39.627ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8592024-12-07T00:46:39.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 47.068067ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8602024-12-07T00:46:39.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 124.195589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8612024-12-07T00:46:39.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 59.686899ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8622024-12-07T00:46:39.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 138.195379ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8632024-12-07T00:46:40.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 135.095922ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8642024-12-07T00:46:40.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 214.259035ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8652024-12-07T00:46:40.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 227.210228ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8662024-12-07T00:46:41.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 154.849457ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8672024-12-07T00:46:41.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 72.889459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8682024-12-07T00:46:41.923ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41499
8692024-12-07T00:46:41.923ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41499 req_id = ba3d3181-d3f7-4d0c-9b7d-0fc6a24fa4b4 response_code = 200 uri = /baseboard
8702024-12-07T00:46:41.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 229.735041ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8712024-12-07T00:46:41.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 412.656591ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8722024-12-07T00:46:41.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 215.890969ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8732024-12-07T00:46:42.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 139.812022ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8742024-12-07T00:46:42.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 530.135173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8752024-12-07T00:46:42.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 250.931515ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8762024-12-07T00:46:42.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 454.569882ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8772024-12-07T00:46:42.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 839.733675ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8782024-12-07T00:46:42.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 1.063784298s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8792024-12-07T00:46:42.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 486.088975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8802024-12-07T00:46:42.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 1.01089003s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8812024-12-07T00:46:42.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 584.716251ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8822024-12-07T00:46:42.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 933.217462ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8832024-12-07T00:46:43.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 873.311315ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8842024-12-07T00:46:43.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 1.2163178s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8852024-12-07T00:46:43.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 560.889986ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8862024-12-07T00:46:43.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 1.459385255s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8872024-12-07T00:46:43.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 1.012029468s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8882024-12-07T00:46:43.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 1.270868017s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8892024-12-07T00:46:44.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 686.640787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8902024-12-07T00:46:44.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 766.927128ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8912024-12-07T00:46:44.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 1.181122879s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8922024-12-07T00:46:44.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 1.190079198s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8932024-12-07T00:46:45.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 1.046920397s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
8942024-12-07T00:46:45.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 1.230653212s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
8952024-12-07T00:46:45.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 644.541202ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8962024-12-07T00:46:45.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 594.357798ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
8972024-12-07T00:46:45.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 1.015675529s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
8982024-12-07T00:46:46.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 1.4749546s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
8992024-12-07T00:46:46.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 636.330605ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9002024-12-07T00:46:46.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 927.070191ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9012024-12-07T00:46:46.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 775.950585ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9022024-12-07T00:46:46.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 1.296793021s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9032024-12-07T00:46:46.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 990.866883ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9042024-12-07T00:46:47.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 667.346432ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9052024-12-07T00:46:47.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 887.075478ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9062024-12-07T00:46:47.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 1.305256092s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
9072024-12-07T00:46:47.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 740.510186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9082024-12-07T00:46:47.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 1.204958032s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9092024-12-07T00:46:48.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 1.060489889s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9102024-12-07T00:46:48.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 522.36214ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9112024-12-07T00:46:48.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 1.356001881s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9122024-12-07T00:46:48.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 591.947284ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9132024-12-07T00:46:48.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 869.485125ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
9142024-12-07T00:46:49.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 521.142504ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9152024-12-07T00:46:49.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 1.009007638s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9162024-12-07T00:46:49.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 1.266763817s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9172024-12-07T00:46:49.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 615.801111ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9182024-12-07T00:46:49.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 822.511414ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
9192024-12-07T00:46:50.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 672.66752ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9202024-12-07T00:46:50.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 1.355418026s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9212024-12-07T00:46:50.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 929.022626ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9222024-12-07T00:46:50.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd") failed: Property not found. retry in 1.279537328s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
9232024-12-07T00:46:50.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f") failed: Property not found. retry in 1.270353149s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9242024-12-07T00:46:50.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 920.731464ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9252024-12-07T00:46:51.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0") failed: Property not found. retry in 941.803096ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9262024-12-07T00:46:51.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0") failed: Property not found. retry in 518.324533ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9272024-12-07T00:46:51.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c") failed: Property not found. retry in 862.619644ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9282024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_7b88a190-b92e-4019-bea8-d22c40d8551c
9292024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1e766793-b675-48d5-b60e-8c57f234f66f
9302024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_92a6da63-3b7e-4ef0-bfe9-6bc6299305e0
9312024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1e4134a0-b9c4-4e22-910b-2429957984cd
9322024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0
9332024-12-07T00:46:52.580ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9342024-12-07T00:46:52.581ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9352024-12-07T00:46:52.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16314057 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53172 req_id = c7a5396e-a29e-41db-9f31-1d2e4aaf6a5c response_code = 204 uri = /omicron-zones
9362024-12-07T00:46:52.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53416
9372024-12-07T00:46:52.655ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 36292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = e912b49a-f110-4e40-95ae-974aa9da51b0 response_code = 500 uri = /cockroachdb
9382024-12-07T00:46:52.655ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e912b49a-f110-4e40-95ae-974aa9da51b0", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e912b49a-f110-4e40-95ae-974aa9da51b0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 54.362828ms
9392024-12-07T00:46:52.747ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 37039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 28441be2-d089-4b6c-9a8d-565355be7061 response_code = 500 uri = /cockroachdb
9402024-12-07T00:46:52.748ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "28441be2-d089-4b6c-9a8d-565355be7061", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "28441be2-d089-4b6c-9a8d-565355be7061" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 97.834886ms
9412024-12-07T00:46:52.874ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 4a96b348-4be9-4d93-8845-ddb96c2b53b8 response_code = 500 uri = /cockroachdb
9422024-12-07T00:46:52.875ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4a96b348-4be9-4d93-8845-ddb96c2b53b8", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4a96b348-4be9-4d93-8845-ddb96c2b53b8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 182.533058ms
9432024-12-07T00:46:53.085ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = fcc296d2-bd20-46a6-bdbd-66ba85fc83bd response_code = 500 uri = /cockroachdb
9442024-12-07T00:46:53.085ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fcc296d2-bd20-46a6-bdbd-66ba85fc83bd", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fcc296d2-bd20-46a6-bdbd-66ba85fc83bd" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 256.481221ms
9452024-12-07T00:46:53.112ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 338.400089ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9462024-12-07T00:46:53.369ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26900 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = bf69eb3a-188c-4c33-9ee0-70f859eb3e12 response_code = 500 uri = /cockroachdb
9472024-12-07T00:46:53.369ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf69eb3a-188c-4c33-9ee0-70f859eb3e12", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf69eb3a-188c-4c33-9ee0-70f859eb3e12" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 221.993314ms
9482024-12-07T00:46:53.618ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26068 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 9609118a-5b4f-46f4-a7df-362410a864b6 response_code = 500 uri = /cockroachdb
9492024-12-07T00:46:53.618ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9609118a-5b4f-46f4-a7df-362410a864b6", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9609118a-5b4f-46f4-a7df-362410a864b6" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 365.700104ms
9502024-12-07T00:46:54.011ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26234 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 402e28d9-eeb6-4968-b7a4-eb3a69c676a8 response_code = 500 uri = /cockroachdb
9512024-12-07T00:46:54.011ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "402e28d9-eeb6-4968-b7a4-eb3a69c676a8", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "402e28d9-eeb6-4968-b7a4-eb3a69c676a8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 152.061943ms
9522024-12-07T00:46:54.188ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 23878 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 6351553f-895d-432e-8703-90f66d2c8fa7 response_code = 500 uri = /cockroachdb
9532024-12-07T00:46:54.189ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6351553f-895d-432e-8703-90f66d2c8fa7", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6351553f-895d-432e-8703-90f66d2c8fa7" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 295.096766ms
9542024-12-07T00:46:54.511ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = b58c2b28-68f7-48cb-9d79-f8e38185d9ba response_code = 500 uri = /cockroachdb
9552024-12-07T00:46:54.511ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b58c2b28-68f7-48cb-9d79-f8e38185d9ba", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b58c2b28-68f7-48cb-9d79-f8e38185d9ba" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 257.156506ms
9562024-12-07T00:46:54.796ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 114d725f-1f9c-4fd8-9bfb-872be99030b0 response_code = 500 uri = /cockroachdb
9572024-12-07T00:46:54.796ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "114d725f-1f9c-4fd8-9bfb-872be99030b0", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "114d725f-1f9c-4fd8-9bfb-872be99030b0" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 673.656042ms
9582024-12-07T00:46:55.496ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1481398d-7590-4d5f-a745-059b743b42d0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = aa296ed5-aae2-4939-abf2-f1f987d67f29 response_code = 500 uri = /cockroachdb
9592024-12-07T00:46:55.496ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "aa296ed5-aae2-4939-abf2-f1f987d67f29", "content-length": "124", "date": "Sat, 07 Dec 2024 00:46:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "aa296ed5-aae2-4939-abf2-f1f987d67f29" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 545.003537ms
9602024-12-07T00:46:56.073ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3743
9612024-12-07T00:47:15.463ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
9622024-12-07T00:47:25.975ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
9632024-12-07T00:47:25.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29931724 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:53416 req_id = 14c372e1-8adb-4e46-884e-7e8cca0f852f response_code = 204 uri = /cockroachdb
9642024-12-07T00:47:25.978ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39437
9652024-12-07T00:47:25.980ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 826 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39437 req_id = eff98b16-6b43-4137-b444-733cefd2d2f5 response_code = 200 uri = /baseboard
9662024-12-07T00:47:25.986ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.050637129s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
9672024-12-07T00:47:26.028ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: fd72061d-6779-40de-8011-8e899981c9e7 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: be11a55e-cb67-4535-ad44-b9a4d4586728 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 83dd33bf-63d5-469c-89b8-0090fc119721 (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 24e3e3c6-6abd-44ac-b07a-67f36e1b4c25, kind: Service { id: 83dd33bf-63d5-469c-89b8-0090fc119721 }, name: Name("ntp-83dd33bf-63d5-469c-89b8-0090fc119721"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 200])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 1e766793-b675-48d5-b60e-8c57f234f66f (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } } } }, OmicronZoneConfig { id: 7b88a190-b92e-4019-bea8-d22c40d8551c (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1e4134a0-b9c4-4e22-910b-2429957984cd (service), filesystem_pool: Some(ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External } } } }, OmicronZoneConfig { id: 1481398d-7590-4d5f-a745-059b743b42d0 (service), filesystem_pool: Some(ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External } } } }, OmicronZoneConfig { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 (service), filesystem_pool: Some(ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a (service), filesystem_pool: Some(ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 00ea6ad0-de1a-4101-a100-38e35668045b (service), filesystem_pool: Some(ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0c426bb3-2016-46d9-ae49-782d763f4e64 (service), filesystem_pool: Some(ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 49a973b5-0152-4c36-a919-88da074bedee (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } } } }, OmicronZoneConfig { id: ff869b53-63c0-4bab-b98b-b646505a24f5 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: dee32b86-ebdb-4e1d-ba91-d338a27868d1 (service), filesystem_pool: Some(ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 187fa835-bac3-45fd-849b-fc67b5e09a53 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: d55412ed-9210-461a-ad13-2342f0e75fe3 (service), filesystem_pool: Some(ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External } } } }, OmicronZoneConfig { id: 932b6a15-6e02-4acb-98a3-4e95ec16d6ae (service), filesystem_pool: Some(ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 71d96fc8-28af-43c3-9eb5-97ef5b28c882 (service), filesystem_pool: Some(ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External } } } }, OmicronZoneConfig { id: b5acdb8f-00d3-471c-8b21-1c68caed3850 (service), filesystem_pool: Some(ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External } } } }, OmicronZoneConfig { id: c0b9aa99-242b-42ef-995b-c74bda11f3fd (service), filesystem_pool: Some(ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External } } } }, OmicronZoneConfig { id: d47d99fb-676d-4ab6-a275-60fcc1d62c76 (service), filesystem_pool: Some(ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External } } } }, OmicronZoneConfig { id: e5417ff1-7531-468e-87b9-689f3c20ff7c (service), filesystem_pool: Some(ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External } } } }, OmicronZoneConfig { id: 6aa7a50c-6dab-4ead-be98-15f377a7808f (service), filesystem_pool: Some(ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b9ceea-1236-4610-b190-e90d8a85abd6 (service), filesystem_pool: Some(ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9682024-12-07T00:47:26.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46166
9692024-12-07T00:47:26.031ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9702024-12-07T00:47:26.031ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fd72061d-6779-40de-8011-8e899981c9e7, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9712024-12-07T00:47:26.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9722024-12-07T00:47:26.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5661fac0-67b8-45f8-869a-67dd3e21bd0b, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9732024-12-07T00:47:26.154ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9742024-12-07T00:47:26.154ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: be11a55e-cb67-4535-ad44-b9a4d4586728, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9752024-12-07T00:47:26.204ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e766793-b675-48d5-b60e-8c57f234f66f, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9762024-12-07T00:47:26.204ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e766793-b675-48d5-b60e-8c57f234f66f, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9772024-12-07T00:47:26.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7b88a190-b92e-4019-bea8-d22c40d8551c, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9782024-12-07T00:47:26.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 7b88a190-b92e-4019-bea8-d22c40d8551c, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9792024-12-07T00:47:26.300ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9802024-12-07T00:47:26.300ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 92a6da63-3b7e-4ef0-bfe9-6bc6299305e0, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9812024-12-07T00:47:26.346ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1e4134a0-b9c4-4e22-910b-2429957984cd, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9822024-12-07T00:47:26.346ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1e4134a0-b9c4-4e22-910b-2429957984cd, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9832024-12-07T00:47:26.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1481398d-7590-4d5f-a745-059b743b42d0, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
9842024-12-07T00:47:26.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1481398d-7590-4d5f-a745-059b743b42d0, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9852024-12-07T00:47:26.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eda26d3e-18ec-4c21-8ff4-73abfd373bec, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9862024-12-07T00:47:26.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: eda26d3e-18ec-4c21-8ff4-73abfd373bec, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9872024-12-07T00:47:26.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fe4d45f4-708c-423b-9b9c-06a074a360b5, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
9882024-12-07T00:47:26.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: fe4d45f4-708c-423b-9b9c-06a074a360b5, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9892024-12-07T00:47:26.559ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 49a973b5-0152-4c36-a919-88da074bedee, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
9902024-12-07T00:47:26.559ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 49a973b5-0152-4c36-a919-88da074bedee, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9912024-12-07T00:47:26.607ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d55412ed-9210-461a-ad13-2342f0e75fe3, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9922024-12-07T00:47:26.607ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d55412ed-9210-461a-ad13-2342f0e75fe3, dataset_name: DatasetName { pool_name: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, kind: Crucible }, responder: ... }
9932024-12-07T00:47:26.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 932b6a15-6e02-4acb-98a3-4e95ec16d6ae, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9942024-12-07T00:47:26.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 932b6a15-6e02-4acb-98a3-4e95ec16d6ae, dataset_name: DatasetName { pool_name: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, kind: Crucible }, responder: ... }
9952024-12-07T00:47:26.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 71d96fc8-28af-43c3-9eb5-97ef5b28c882, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9962024-12-07T00:47:26.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 71d96fc8-28af-43c3-9eb5-97ef5b28c882, dataset_name: DatasetName { pool_name: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, kind: Crucible }, responder: ... }
9972024-12-07T00:47:26.749ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b5acdb8f-00d3-471c-8b21-1c68caed3850, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
9982024-12-07T00:47:26.749ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b5acdb8f-00d3-471c-8b21-1c68caed3850, dataset_name: DatasetName { pool_name: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, kind: Crucible }, responder: ... }
9992024-12-07T00:47:26.795ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c0b9aa99-242b-42ef-995b-c74bda11f3fd, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10002024-12-07T00:47:26.795ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c0b9aa99-242b-42ef-995b-c74bda11f3fd, dataset_name: DatasetName { pool_name: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, kind: Crucible }, responder: ... }
10012024-12-07T00:47:26.836ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d47d99fb-676d-4ab6-a275-60fcc1d62c76, dataset_name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10022024-12-07T00:47:26.836ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d47d99fb-676d-4ab6-a275-60fcc1d62c76, dataset_name: DatasetName { pool_name: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, kind: Crucible }, responder: ... }
10032024-12-07T00:47:26.893ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e5417ff1-7531-468e-87b9-689f3c20ff7c, dataset_name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10042024-12-07T00:47:26.893ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e5417ff1-7531-468e-87b9-689f3c20ff7c, dataset_name: DatasetName { pool_name: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, kind: Crucible }, responder: ... }
10052024-12-07T00:47:26.946ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6aa7a50c-6dab-4ead-be98-15f377a7808f, dataset_name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10062024-12-07T00:47:26.946ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6aa7a50c-6dab-4ead-be98-15f377a7808f, dataset_name: DatasetName { pool_name: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, kind: Crucible }, responder: ... }
10072024-12-07T00:47:26.995ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 53b9ceea-1236-4610-b190-e90d8a85abd6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10082024-12-07T00:47:26.995ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 53b9ceea-1236-4610-b190-e90d8a85abd6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, kind: Crucible }, responder: ... }
10092024-12-07T00:47:27.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10102024-12-07T00:47:27.046ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
10112024-12-07T00:47:27.046ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
10122024-12-07T00:47:27.047ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10132024-12-07T00:47:27.203ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10142024-12-07T00:47:27.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10152024-12-07T00:47:27.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10162024-12-07T00:47:27.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10172024-12-07T00:47:27.217ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10182024-12-07T00:47:27.217ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10192024-12-07T00:47:27.220ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10202024-12-07T00:47:27.220ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10212024-12-07T00:47:27.247ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10222024-12-07T00:47:27.247ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10232024-12-07T00:47:27.247ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10242024-12-07T00:47:27.433ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10252024-12-07T00:47:27.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10262024-12-07T00:47:27.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10272024-12-07T00:47:27.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10282024-12-07T00:47:27.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10292024-12-07T00:47:27.433ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10302024-12-07T00:47:27.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10312024-12-07T00:47:27.447ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10322024-12-07T00:47:27.447ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882 file = illumos-utils/src/zone.rs:325
10332024-12-07T00:47:27.452ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd file = illumos-utils/src/zone.rs:325
10342024-12-07T00:47:27.458ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76 file = illumos-utils/src/zone.rs:325
10352024-12-07T00:47:27.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c file = illumos-utils/src/zone.rs:325
10362024-12-07T00:47:27.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53 file = illumos-utils/src/zone.rs:325
10372024-12-07T00:47:27.474ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee file = illumos-utils/src/zone.rs:325
10382024-12-07T00:47:27.479ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850 file = illumos-utils/src/zone.rs:325
10392024-12-07T00:47:27.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882 file = illumos-utils/src/zone.rs:363
10402024-12-07T00:47:27.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd file = illumos-utils/src/zone.rs:363
10412024-12-07T00:47:27.645ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76 file = illumos-utils/src/zone.rs:363
10422024-12-07T00:47:27.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c file = illumos-utils/src/zone.rs:363
10432024-12-07T00:47:27.656ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53 file = illumos-utils/src/zone.rs:363
10442024-12-07T00:47:27.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee file = illumos-utils/src/zone.rs:363
10452024-12-07T00:47:27.666ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850 file = illumos-utils/src/zone.rs:363
10462024-12-07T00:47:27.672ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64 file = illumos-utils/src/zone.rs:325
10472024-12-07T00:47:27.677ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3 file = illumos-utils/src/zone.rs:325
10482024-12-07T00:47:27.683ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae file = illumos-utils/src/zone.rs:325
10492024-12-07T00:47:27.690ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5 file = illumos-utils/src/zone.rs:325
10502024-12-07T00:47:27.696ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6 file = illumos-utils/src/zone.rs:325
10512024-12-07T00:47:27.702ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f file = illumos-utils/src/zone.rs:325
10522024-12-07T00:47:27.709ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1 file = illumos-utils/src/zone.rs:325
10532024-12-07T00:47:27.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64 file = illumos-utils/src/zone.rs:363
10542024-12-07T00:47:27.725ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3 file = illumos-utils/src/zone.rs:363
10552024-12-07T00:47:27.734ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae file = illumos-utils/src/zone.rs:363
10562024-12-07T00:47:27.742ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5 file = illumos-utils/src/zone.rs:363
10572024-12-07T00:47:27.750ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6 file = illumos-utils/src/zone.rs:363
10582024-12-07T00:47:27.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f file = illumos-utils/src/zone.rs:363
10592024-12-07T00:47:27.771ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1 file = illumos-utils/src/zone.rs:363
10602024-12-07T00:47:27.849ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10612024-12-07T00:47:27.938ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10622024-12-07T00:47:28.018ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10632024-12-07T00:47:28.079ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10642024-12-07T00:47:28.147ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
10652024-12-07T00:47:28.161ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10662024-12-07T00:47:28.161ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10672024-12-07T00:47:28.228ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 147, 35]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10682024-12-07T00:47:28.228ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10692024-12-07T00:47:28.229ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10702024-12-07T00:47:28.229ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10712024-12-07T00:47:28.283ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 161, 140]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10722024-12-07T00:47:28.283ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
10732024-12-07T00:47:28.285ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10742024-12-07T00:47:28.285ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10752024-12-07T00:47:28.346ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 184, 109]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10762024-12-07T00:47:28.346ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
10772024-12-07T00:47:28.348ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10782024-12-07T00:47:28.348ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10792024-12-07T00:47:28.407ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 194, 217]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10802024-12-07T00:47:28.407ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10812024-12-07T00:47:28.408ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
10822024-12-07T00:47:28.408ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
10832024-12-07T00:47:28.480ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 184, 215]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10842024-12-07T00:47:28.480ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
10852024-12-07T00:47:28.496ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
10862024-12-07T00:47:28.496ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
10872024-12-07T00:47:28.496ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
10882024-12-07T00:47:28.496ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
10892024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
10902024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
10912024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
10922024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
10932024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
10942024-12-07T00:47:28.497ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
10952024-12-07T00:47:28.524ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
10962024-12-07T00:47:28.526ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10972024-12-07T00:47:28.568ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
10982024-12-07T00:47:28.571ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
10992024-12-07T00:47:28.571ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11002024-12-07T00:47:28.575ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11012024-12-07T00:47:28.575ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11022024-12-07T00:47:28.578ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11032024-12-07T00:47:28.578ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11042024-12-07T00:47:28.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11052024-12-07T00:47:28.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5 file = illumos-utils/src/zone.rs:325
11062024-12-07T00:47:28.782ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a file = illumos-utils/src/zone.rs:325
11072024-12-07T00:47:28.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633 file = illumos-utils/src/zone.rs:325
11082024-12-07T00:47:28.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b file = illumos-utils/src/zone.rs:325
11092024-12-07T00:47:28.826ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec file = illumos-utils/src/zone.rs:325
11102024-12-07T00:47:28.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5 file = illumos-utils/src/zone.rs:363
11112024-12-07T00:47:28.850ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a file = illumos-utils/src/zone.rs:363
11122024-12-07T00:47:28.863ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633 file = illumos-utils/src/zone.rs:363
11132024-12-07T00:47:28.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b file = illumos-utils/src/zone.rs:363
11142024-12-07T00:47:28.901ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec file = illumos-utils/src/zone.rs:363
11152024-12-07T00:47:31.763ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162024-12-07T00:47:31.763ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11172024-12-07T00:47:31.918ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1df39b96-70fb-49d5-8a1c-2fbf9b3c302d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11182024-12-07T00:47:31.919ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c79c0a44-95c4-4f9e-8a20-0b6fc39d4905'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11192024-12-07T00:47:31.919ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11202024-12-07T00:47:31.936ZINFOSledAgent (ServiceManager): Booting oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11212024-12-07T00:47:31.968ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9d33808d-deca-4533-adee-690176030136/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9294e23d-a626-4386-9a9c-54599dedbd1c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11222024-12-07T00:47:31.971ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0b7c3d86-a7a7-4f5b-aa69-b2c9dfe373a3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11232024-12-07T00:47:31.971ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_37290789-dec6-48b1-bd11-48c109977543/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='76027018-5363-4992-889d-e73229ce67f2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11242024-12-07T00:47:31.971ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2e4993e7-9cc5-44e6-89f5-9150fe402efb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11252024-12-07T00:47:31.972ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7743e5ae-bc6d-4022-83e7-05d9e009f56b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11262024-12-07T00:47:31.972ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11272024-12-07T00:47:31.994ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11282024-12-07T00:47:32.013ZINFOSledAgent (ServiceManager): Booting oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11292024-12-07T00:47:32.079ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11302024-12-07T00:47:32.109ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11312024-12-07T00:47:32.282ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11322024-12-07T00:47:32.283ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11332024-12-07T00:47:32.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 35.462832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11342024-12-07T00:47:32.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 45.659471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11352024-12-07T00:47:32.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 62.28303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11362024-12-07T00:47:32.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 73.735085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11372024-12-07T00:47:32.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 72.015288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11382024-12-07T00:47:32.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 54.290916ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11392024-12-07T00:47:32.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 98.173226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11402024-12-07T00:47:32.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 30.884165ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11412024-12-07T00:47:32.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 42.876305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11422024-12-07T00:47:32.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 125.503294ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11432024-12-07T00:47:33.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 72.705496ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11442024-12-07T00:47:33.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 132.75704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11452024-12-07T00:47:33.014ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='0c426bb3-2016-46d9-ae49-782d763f4e64'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11462024-12-07T00:47:33.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 120.933741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11472024-12-07T00:47:33.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 149.54695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11482024-12-07T00:47:33.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 136.400454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11492024-12-07T00:47:33.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 66.12688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11502024-12-07T00:47:33.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 99.375519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11512024-12-07T00:47:33.077ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
11522024-12-07T00:47:33.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 145.750875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11532024-12-07T00:47:33.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 134.565061ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11542024-12-07T00:47:33.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 163.229989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11552024-12-07T00:47:33.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 211.662622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11562024-12-07T00:47:33.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 207.179474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11572024-12-07T00:47:33.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 125.172094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11582024-12-07T00:47:33.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 168.401463ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11592024-12-07T00:47:33.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 276.691798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11602024-12-07T00:47:33.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 212.456702ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11612024-12-07T00:47:33.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 569.81279ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11622024-12-07T00:47:33.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 161.312255ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11632024-12-07T00:47:33.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 573.403714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11642024-12-07T00:47:33.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 434.484261ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11652024-12-07T00:47:37.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 319.798819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11662024-12-07T00:47:39.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 309.520287ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11672024-12-07T00:47:39.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 472.485296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11682024-12-07T00:47:39.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 234.163434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11692024-12-07T00:47:39.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 361.645501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11702024-12-07T00:47:39.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.196951341s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
11712024-12-07T00:47:39.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 572.429657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11722024-12-07T00:47:39.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 1.039591853s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
11732024-12-07T00:47:39.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.077741836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
11742024-12-07T00:47:39.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 71.930002ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
11752024-12-07T00:47:39.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.098237273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
11762024-12-07T00:47:39.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 970.282422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
11772024-12-07T00:47:39.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 271.829886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11782024-12-07T00:47:39.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11792024-12-07T00:47:39.655ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a5bc70a7-2f75-4724-9a06-1460cb18ee3e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802024-12-07T00:47:39.656ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
11812024-12-07T00:47:39.666ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
11822024-12-07T00:47:39.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 86.810507ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
11832024-12-07T00:47:39.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 476.377442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11842024-12-07T00:47:39.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 567.812152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
11852024-12-07T00:47:39.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 204.467477ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
11862024-12-07T00:47:39.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 752.021379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
11872024-12-07T00:47:40.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 41.276477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
11882024-12-07T00:47:40.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 522.50244ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
11892024-12-07T00:47:40.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 38.666458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
11902024-12-07T00:47:40.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.249140337s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
11912024-12-07T00:47:40.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 122.346748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
11922024-12-07T00:47:40.126ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11932024-12-07T00:47:40.126ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942024-12-07T00:47:40.126ZINFOSledAgent (ServiceManager): Booting oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
11952024-12-07T00:47:40.135ZINFOSledAgent (ServiceManager): Booting oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
11962024-12-07T00:47:40.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 100.938172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
11972024-12-07T00:47:40.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 107.344688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
11982024-12-07T00:47:40.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.176095553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
11992024-12-07T00:47:40.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 238.589792ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12002024-12-07T00:47:40.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 813.945782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
12012024-12-07T00:47:40.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 299.404914ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12022024-12-07T00:47:40.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 44.703414ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12032024-12-07T00:47:40.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 53.654486ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12042024-12-07T00:47:40.416ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12052024-12-07T00:47:40.416ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12062024-12-07T00:47:40.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 134.527503ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12072024-12-07T00:47:40.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 89.786722ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12082024-12-07T00:47:40.520ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2595d068-0a31-4fc2-8949-bb1325fa6514'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12092024-12-07T00:47:40.520ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12102024-12-07T00:47:40.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 205.532115ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12112024-12-07T00:47:40.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 692.392125ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
12122024-12-07T00:47:40.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 288.881189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12132024-12-07T00:47:40.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 128.675489ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12142024-12-07T00:47:40.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 991.908889ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
12152024-12-07T00:47:40.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 1.496074566s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
12162024-12-07T00:47:40.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.15937736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
12172024-12-07T00:47:40.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 46.472931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12182024-12-07T00:47:40.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 900.91649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
12192024-12-07T00:47:40.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 460.018241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12202024-12-07T00:47:40.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 781.041761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
12212024-12-07T00:47:40.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 84.751623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12222024-12-07T00:47:40.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.074853076s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
12232024-12-07T00:47:40.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 340.750007ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12242024-12-07T00:47:40.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 57.073056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12252024-12-07T00:47:40.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 540.046803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12262024-12-07T00:47:40.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 103.716618ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12272024-12-07T00:47:40.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 87.150968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12282024-12-07T00:47:40.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 478.945674ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12292024-12-07T00:47:40.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 124.683013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12302024-12-07T00:47:40.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 299.072146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12312024-12-07T00:47:40.997ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-12-07T00:47:40.998ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12332024-12-07T00:47:41.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 476.835251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12342024-12-07T00:47:41.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 989.983638ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12352024-12-07T00:47:41.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.365289296s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12362024-12-07T00:47:41.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.349353153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
12372024-12-07T00:47:41.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 923.726366ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
12382024-12-07T00:47:41.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 891.220491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
12392024-12-07T00:47:41.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.163298222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12402024-12-07T00:47:41.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 912.150631ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12412024-12-07T00:47:41.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.14376725s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12422024-12-07T00:47:41.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.462819186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
12432024-12-07T00:47:41.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.275247748s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
12442024-12-07T00:47:41.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.283314905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12452024-12-07T00:47:41.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.175428033s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
12462024-12-07T00:47:41.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 72.570634ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12472024-12-07T00:47:41.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 729.802476ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
12482024-12-07T00:47:41.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 147.435739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12492024-12-07T00:47:41.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 928.58131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
12502024-12-07T00:47:41.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 922.402836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
12512024-12-07T00:47:41.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 201.503539ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12522024-12-07T00:47:42.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.195251121s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12532024-12-07T00:47:42.170ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.435432587s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
12542024-12-07T00:47:43.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 621.470911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
12552024-12-07T00:47:43.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 869.479475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
12562024-12-07T00:47:43.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 838.799072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
12572024-12-07T00:47:43.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.486547082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12582024-12-07T00:47:43.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.096645765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
12592024-12-07T00:47:43.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.340895347s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
12602024-12-07T00:47:43.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 621.815735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12612024-12-07T00:47:43.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 547.224022ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
12622024-12-07T00:47:43.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 894.94768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
12632024-12-07T00:47:43.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 585.663982ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12642024-12-07T00:47:43.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.005416329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12652024-12-07T00:47:43.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 1.304185088s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12662024-12-07T00:47:43.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.462886256s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
12672024-12-07T00:47:43.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 739.899171ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12682024-12-07T00:47:43.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 986.759047ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
12692024-12-07T00:47:43.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 564.836775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12702024-12-07T00:47:43.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 546.631193ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
12712024-12-07T00:47:43.733ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12722024-12-07T00:47:43.733ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12732024-12-07T00:47:44.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 64.887425ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12742024-12-07T00:47:44.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 921.744947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
12752024-12-07T00:47:44.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 1.014366502s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
12762024-12-07T00:47:44.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 143.279716ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12772024-12-07T00:47:44.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 673.958973ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12782024-12-07T00:47:44.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 678.176626ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12792024-12-07T00:47:44.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 971.245881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
12802024-12-07T00:47:44.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.290700051s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
12812024-12-07T00:47:44.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 103.144351ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12822024-12-07T00:47:44.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.099877145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
12832024-12-07T00:47:44.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 573.542333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
12842024-12-07T00:47:44.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.433062392s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
12852024-12-07T00:47:44.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 438.688868ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12862024-12-07T00:47:44.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 524.73636ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
12872024-12-07T00:47:44.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 703.872093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
12882024-12-07T00:47:44.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.081747466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
12892024-12-07T00:47:44.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 940.045764ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
12902024-12-07T00:47:44.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 1.017582375s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
12912024-12-07T00:47:44.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 759.802344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
12922024-12-07T00:47:44.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.304741954s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
12932024-12-07T00:47:45.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.235369577s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
12942024-12-07T00:47:45.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 650.867702ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
12952024-12-07T00:47:45.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.079758087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
12962024-12-07T00:47:45.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 919.798379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
12972024-12-07T00:47:45.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 1.208570322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
12982024-12-07T00:47:45.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 651.039952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
12992024-12-07T00:47:45.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 738.230315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13002024-12-07T00:47:45.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 1.424331243s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13012024-12-07T00:47:45.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.117023189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
13022024-12-07T00:47:45.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.174735668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
13032024-12-07T00:47:45.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.307036215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
13042024-12-07T00:47:45.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.36119471s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
13052024-12-07T00:47:45.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 1.389049077s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
13062024-12-07T00:47:45.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 782.055639ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13072024-12-07T00:47:45.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 784.410566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
13082024-12-07T00:47:45.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.105969822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
13092024-12-07T00:47:45.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 674.477532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13102024-12-07T00:47:45.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 514.966728ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13112024-12-07T00:47:45.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.442488239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13122024-12-07T00:47:45.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 610.170848ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
13132024-12-07T00:47:46.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 501.829915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
13142024-12-07T00:47:46.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.430520519s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
13152024-12-07T00:47:46.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.33680133s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
13162024-12-07T00:47:46.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.105107274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
13172024-12-07T00:47:46.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 887.075789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
13182024-12-07T00:47:46.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.056402221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
13192024-12-07T00:47:46.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 560.539647ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13202024-12-07T00:47:46.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 608.352601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13212024-12-07T00:47:46.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 1.13244942s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13222024-12-07T00:47:46.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.029782238s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
13232024-12-07T00:47:46.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.025776966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
13242024-12-07T00:47:46.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 537.605079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
13252024-12-07T00:47:46.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 1.390253127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
13262024-12-07T00:47:46.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 1.149699769s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13272024-12-07T00:47:46.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 512.933442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
13282024-12-07T00:47:46.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 616.238242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
13292024-12-07T00:47:46.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 885.703804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
13302024-12-07T00:47:47.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.352917976s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13312024-12-07T00:47:47.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 1.486596157s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
13322024-12-07T00:47:47.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 969.353071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13332024-12-07T00:47:47.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.448593072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
13342024-12-07T00:47:47.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 1.297806109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
13352024-12-07T00:47:47.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.108670912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
13362024-12-07T00:47:47.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 909.399254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13372024-12-07T00:47:47.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 951.117126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
13382024-12-07T00:47:47.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.309174282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
13392024-12-07T00:47:47.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.187220313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
13402024-12-07T00:47:47.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.209713938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
13412024-12-07T00:47:47.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 782.442538ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
13422024-12-07T00:47:47.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 796.862029ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
13432024-12-07T00:47:47.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 593.318461ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
13442024-12-07T00:47:47.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 785.135635ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13452024-12-07T00:47:47.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 709.492379ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13462024-12-07T00:47:47.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 608.00334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
13472024-12-07T00:47:48.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 627.989518ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
13482024-12-07T00:47:48.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 500.808192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13492024-12-07T00:47:48.136ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502024-12-07T00:47:48.137ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13512024-12-07T00:47:48.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.028158328s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
13522024-12-07T00:47:48.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 903.910455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13532024-12-07T00:47:48.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.041572811s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13542024-12-07T00:47:48.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.26669506s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
13552024-12-07T00:47:48.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.199169582s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
13562024-12-07T00:47:48.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 65.012069ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13572024-12-07T00:47:48.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 646.513276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
13582024-12-07T00:47:48.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 1.147813759s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13592024-12-07T00:47:48.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 872.752623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
13602024-12-07T00:47:48.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 109.229516ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13612024-12-07T00:47:48.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 885.583306ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13622024-12-07T00:47:48.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.390298269s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
13632024-12-07T00:47:48.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 889.424853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
13642024-12-07T00:47:48.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.162741705s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
13652024-12-07T00:47:48.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 170.546168ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13662024-12-07T00:47:48.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 1.476225435s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
13672024-12-07T00:47:48.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.064128285s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
13682024-12-07T00:47:48.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 807.023608ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13692024-12-07T00:47:48.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 935.256916ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
13702024-12-07T00:47:48.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.002817709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
13712024-12-07T00:47:48.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 1.108005212s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
13722024-12-07T00:47:49.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 370.97631ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13732024-12-07T00:47:49.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.305368041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
13742024-12-07T00:47:49.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 553.212153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13752024-12-07T00:47:49.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 629.351047ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
13762024-12-07T00:47:49.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 1.070173581s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
13772024-12-07T00:47:49.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 602.257236ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13782024-12-07T00:47:49.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 868.434853ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13792024-12-07T00:47:49.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 645.712149ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13802024-12-07T00:47:49.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 602.427197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
13812024-12-07T00:47:49.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 676.521988ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13822024-12-07T00:47:49.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 580.497597ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
13832024-12-07T00:47:49.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 896.365513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
13842024-12-07T00:47:49.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5") failed: Property not found. retry in 1.248839756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
13852024-12-07T00:47:49.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.098856651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
13862024-12-07T00:47:49.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 523.075238ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
13872024-12-07T00:47:49.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 986.202045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
13882024-12-07T00:47:49.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.302898171s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
13892024-12-07T00:47:49.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.390155497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
13902024-12-07T00:47:49.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 836.266039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
13912024-12-07T00:47:50.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 642.732745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
13922024-12-07T00:47:50.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.137959443s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
13932024-12-07T00:47:50.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 836.508705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
13942024-12-07T00:47:50.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5") failed: Property not found. retry in 781.091026ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
13952024-12-07T00:47:50.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c") failed: Property not found. retry in 889.839879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
13962024-12-07T00:47:50.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.120867424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
13972024-12-07T00:47:50.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 1.040708708s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
13982024-12-07T00:47:50.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.296485284s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
13992024-12-07T00:47:50.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 564.450673ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
14002024-12-07T00:47:50.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 1.195497119s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14012024-12-07T00:47:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 646.77821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
14022024-12-07T00:47:50.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 555.299942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
14032024-12-07T00:47:50.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.343663119s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
14042024-12-07T00:47:50.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.036893853s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
14052024-12-07T00:47:50.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 613.171663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
14062024-12-07T00:47:50.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 839.502334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
14072024-12-07T00:47:50.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 666.621642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14082024-12-07T00:47:50.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 614.121123ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14092024-12-07T00:47:50.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 984.457994ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
14102024-12-07T00:47:51.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f") failed: Property not found. retry in 943.11755ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
14112024-12-07T00:47:51.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 787.207553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
14122024-12-07T00:47:51.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.421757091s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
14132024-12-07T00:47:51.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 715.207067ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
14142024-12-07T00:47:51.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.204319147s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14152024-12-07T00:47:51.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 1.167595498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
14162024-12-07T00:47:51.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 910.383783ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
14172024-12-07T00:47:51.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 1.084302284s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
14182024-12-07T00:47:51.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 732.700799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14192024-12-07T00:47:51.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 698.701865ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14202024-12-07T00:47:51.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 1.446183336s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14212024-12-07T00:47:51.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 1.474330318s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
14222024-12-07T00:47:51.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.372348971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
14232024-12-07T00:47:51.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 827.101587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
14242024-12-07T00:47:51.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 1.414513909s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
14252024-12-07T00:47:51.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 502.254492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
14262024-12-07T00:47:52.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 1.427131046s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
14272024-12-07T00:47:52.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 751.501412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
14282024-12-07T00:47:52.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 820.127241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14292024-12-07T00:47:52.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 724.040047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14302024-12-07T00:47:52.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.285346416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
14312024-12-07T00:47:52.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 1.45037678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
14322024-12-07T00:47:52.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.032187979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
14332024-12-07T00:47:52.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1") failed: Property not found. retry in 829.26661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
14342024-12-07T00:47:52.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 943.662586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
14352024-12-07T00:47:52.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 657.071844ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14362024-12-07T00:47:52.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 724.447002ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
14372024-12-07T00:47:52.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.205887493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
14382024-12-07T00:47:53.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 844.934882ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14392024-12-07T00:47:53.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 503.819725ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14402024-12-07T00:47:53.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 696.625155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
14412024-12-07T00:47:53.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 661.73978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14422024-12-07T00:47:53.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 709.947499ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
14432024-12-07T00:47:53.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64") failed: Property not found. retry in 989.815439ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
14442024-12-07T00:47:53.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 868.331552ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14452024-12-07T00:47:53.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 917.450752ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14462024-12-07T00:47:53.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3") failed: Property not found. retry in 1.187913793s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
14472024-12-07T00:47:53.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae") failed: Property not found. retry in 987.026785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
14482024-12-07T00:47:53.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 852.411224ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
14492024-12-07T00:47:53.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633") failed: Property not found. retry in 994.848437ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
14502024-12-07T00:47:53.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6") failed: Property not found. retry in 1.418699366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
14512024-12-07T00:47:53.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850") failed: Property not found. retry in 1.38764837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14522024-12-07T00:47:53.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53") failed: Property not found. retry in 1.266054489s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
14532024-12-07T00:47:53.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b") failed: Property not found. retry in 791.217661ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
14542024-12-07T00:47:53.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882") failed: Property not found. retry in 928.045207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14552024-12-07T00:47:53.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd") failed: Property not found. retry in 817.553215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
14562024-12-07T00:47:54.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76") failed: Property not found. retry in 1.037729336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
14572024-12-07T00:47:54.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 537.140149ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14582024-12-07T00:47:54.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a") failed: Property not found. retry in 1.305209722s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
14592024-12-07T00:47:54.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec") failed: Property not found. retry in 1.050073303s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14602024-12-07T00:47:54.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 578.564419ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14612024-12-07T00:47:55.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.169847684s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14622024-12-07T00:47:56.116ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47528
14632024-12-07T00:47:56.120ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47528 req_id = c96ebbf2-76ce-4f3f-9c86-2ab95c71121d response_code = 200 uri = /baseboard
14642024-12-07T00:47:56.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.284422081s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14652024-12-07T00:47:57.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 947.157162ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14662024-12-07T00:47:58.737ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.079215867s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
14672024-12-07T00:47:58.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.067930256s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14682024-12-07T00:47:59.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.309959317s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14692024-12-07T00:48:01.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 700.608239ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14702024-12-07T00:48:01.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 1.03967924s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14712024-12-07T00:48:02.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee") failed: Property not found. retry in 598.260491ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14722024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_71d96fc8-28af-43c3-9eb5-97ef5b28c882
14732024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_c0b9aa99-242b-42ef-995b-c74bda11f3fd
14742024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d47d99fb-676d-4ab6-a275-60fcc1d62c76
14752024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_fe4d45f4-708c-423b-9b9c-06a074a360b5
14762024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e5417ff1-7531-468e-87b9-689f3c20ff7c
14772024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_f962ecee-32c8-4ce5-b495-b2a9e4cf161a
14782024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_187fa835-bac3-45fd-849b-fc67b5e09a53
14792024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_046d7edc-b85d-4313-a8cb-1398fbeee633
14802024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_49a973b5-0152-4c36-a919-88da074bedee
14812024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_b5acdb8f-00d3-471c-8b21-1c68caed3850
14822024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_00ea6ad0-de1a-4101-a100-38e35668045b
14832024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_0c426bb3-2016-46d9-ae49-782d763f4e64
14842024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d55412ed-9210-461a-ad13-2342f0e75fe3
14852024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_932b6a15-6e02-4acb-98a3-4e95ec16d6ae
14862024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_ff869b53-63c0-4bab-b98b-b646505a24f5
14872024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_53b9ceea-1236-4610-b190-e90d8a85abd6
14882024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_eda26d3e-18ec-4c21-8ff4-73abfd373bec
14892024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_6aa7a50c-6dab-4ead-be98-15f377a7808f
14902024-12-07T00:48:03.590ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_dee32b86-ebdb-4e1d-ba91-d338a27868d1
14912024-12-07T00:48:03.592ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14922024-12-07T00:48:03.604ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14932024-12-07T00:48:03.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37601183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46166 req_id = 5a722b94-dad9-45dc-b671-7a733dd928fa response_code = 204 uri = /omicron-zones
14942024-12-07T00:48:03.636ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
14952024-12-07T00:48:03.716ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
14962024-12-07T00:48:03.718ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:802
14972024-12-07T00:48:03.763ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
14982024-12-07T00:48:03.788ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
14992024-12-07T00:48:03.852ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.928857573s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
15002024-12-07T00:48:03.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15012024-12-07T00:48:04.028ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15022024-12-07T00:48:04.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15032024-12-07T00:48:04.254ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15042024-12-07T00:48:04.507ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15052024-12-07T00:48:04.879ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15062024-12-07T00:48:05.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15072024-12-07T00:48:05.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15082024-12-07T00:48:06.180ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15092024-12-07T00:48:06.670ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15102024-12-07T00:48:07.408ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15112024-12-07T00:48:07.874ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15122024-12-07T00:48:08.968ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/667e4910-296b-4cf9-a580-7c638e7aa45a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
15132024-12-07T00:48:11.644ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6ea6883d-7c65-4bc4-ba9a-f8f364ba2497", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"667e4910-296b-4cf9-a580-7c638e7aa45a\"", request_id: "6ea6883d-7c65-4bc4-ba9a-f8f364ba2497" } file = sled-agent/src/rack_setup/service.rs:1078
15142024-12-07T00:48:14.328ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e97ab079-816a-4dfa-87b7-eb0545dff465", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"667e4910-296b-4cf9-a580-7c638e7aa45a\"", request_id: "e97ab079-816a-4dfa-87b7-eb0545dff465" } file = sled-agent/src/rack_setup/service.rs:1078
15152024-12-07T00:48:15.888ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ef7ca352-a63d-48e2-9fa7-aad332844a0c", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:15 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"667e4910-296b-4cf9-a580-7c638e7aa45a\"", request_id: "ef7ca352-a63d-48e2-9fa7-aad332844a0c" } file = sled-agent/src/rack_setup/service.rs:1078
15162024-12-07T00:48:19.391ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8f392f86-8e66-4b3b-a7c3-b90b9e2423f1", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:19 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "8f392f86-8e66-4b3b-a7c3-b90b9e2423f1" } file = sled-agent/src/rack_setup/service.rs:1078
15172024-12-07T00:48:22.175ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "636abfa4-770b-4716-a128-6247ccdeb811", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "636abfa4-770b-4716-a128-6247ccdeb811" } file = sled-agent/src/rack_setup/service.rs:1078
15182024-12-07T00:48:26.157ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55243
15192024-12-07T00:48:26.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55243 req_id = e508934b-2a86-49b6-9f6f-3bf0fb5087d5 response_code = 200 uri = /baseboard
15202024-12-07T00:48:26.722ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b255fbf3-819d-4f41-9318-6e3ac2404ade", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:26 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "b255fbf3-819d-4f41-9318-6e3ac2404ade" } file = sled-agent/src/rack_setup/service.rs:1078
15212024-12-07T00:48:27.461ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:51308 remote_addr = [fd00:1122:3344:101::d]:39781 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
15222024-12-07T00:48:27.487ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24095 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 853ff2be-8b74-48c9-a18f-90848de77a04 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
15232024-12-07T00:48:30.120ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "774edcaa-a642-40b7-beb8-635df719c30d", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:29 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "774edcaa-a642-40b7-beb8-635df719c30d" } file = sled-agent/src/rack_setup/service.rs:1078
15242024-12-07T00:48:34.194ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c38740d7-e2a1-4952-92f6-c5dd34da45e5", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "c38740d7-e2a1-4952-92f6-c5dd34da45e5" } file = sled-agent/src/rack_setup/service.rs:1078
15252024-12-07T00:48:37.860ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cca7e486-5401-4eb1-954a-da9a7de86368", "content-length": "173", "date": "Sat, 07 Dec 2024 00:48:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3\"", request_id: "cca7e486-5401-4eb1-954a-da9a7de86368" } file = sled-agent/src/rack_setup/service.rs:1078
15262024-12-07T00:48:39.450ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
15272024-12-07T00:48:39.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61546
15282024-12-07T00:48:39.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15292024-12-07T00:48:39.646ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15302024-12-07T00:48:39.646ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
15312024-12-07T00:48:39.650ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
15322024-12-07T00:48:39.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15332024-12-07T00:48:39.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f
15342024-12-07T00:48:39.688ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15352024-12-07T00:48:39.688ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8
15362024-12-07T00:48:39.709ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15372024-12-07T00:48:39.709ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37290789-dec6-48b1-bd11-48c109977543
15382024-12-07T00:48:39.729ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15392024-12-07T00:48:39.729ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b
15402024-12-07T00:48:39.752ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15412024-12-07T00:48:39.752ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14
15422024-12-07T00:48:39.772ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15432024-12-07T00:48:39.772ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c
15442024-12-07T00:48:39.792ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15452024-12-07T00:48:39.792ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c
15462024-12-07T00:48:39.811ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15472024-12-07T00:48:39.811ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7
15482024-12-07T00:48:39.833ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
15492024-12-07T00:48:39.833ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9d33808d-deca-4533-adee-690176030136
15502024-12-07T00:48:39.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61546 req_id = 550cabb1-ec76-4388-a046-dff326d29ca1 response_code = 200 uri = /inventory
15512024-12-07T00:48:46.362ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54117
15522024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15532024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15542024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15552024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15562024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15572024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15582024-12-07T00:48:46.369ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15592024-12-07T00:48:46.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6746 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54117 req_id = 554acf0d-d022-4f60-a942-ddc658f19794 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15602024-12-07T00:48:46.370ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
15612024-12-07T00:48:46.373ZINFOSledAgent (RSS): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15622024-12-07T00:48:46.375ZINFOSledAgent (RSS): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15632024-12-07T00:48:46.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45626
15642024-12-07T00:48:46.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45626 req_id = c37f1f32-1a89-49c1-8d01-e532ff6b5c07 response_code = 200 uri = /vpc-routes
15652024-12-07T00:48:46.509ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
15662024-12-07T00:48:46.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1075 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45626 req_id = 9277d17b-c574-4049-b680-305e3b472cda response_code = 204 uri = /eip-gateways
15672024-12-07T00:48:46.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58112
15682024-12-07T00:48:46.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 384 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58112 req_id = 4ae0ba6a-513b-4423-9f3f-f637a55d083f response_code = 200 uri = /v2p
15692024-12-07T00:48:46.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58248
15702024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15712024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15722024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15732024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15742024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15752024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15762024-12-07T00:48:46.812ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15772024-12-07T00:48:46.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58248 req_id = fe77a554-9bdc-4690-b1d2-43c7101de67a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15782024-12-07T00:48:46.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38853
15792024-12-07T00:48:46.838ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
15802024-12-07T00:48:46.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
15812024-12-07T00:48:47.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217771 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38853 req_id = c9a7647e-afd1-4cec-85e1-678a1e7e5648 response_code = 204 uri = /switch-ports
15822024-12-07T00:48:47.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55298
15832024-12-07T00:48:47.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61563
15842024-12-07T00:48:47.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61563 req_id = 6b5be306-84e7-440e-b216-3053088ba973 response_code = 200 uri = /vpc-routes
15852024-12-07T00:48:47.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15862024-12-07T00:48:47.055ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
15872024-12-07T00:48:47.055ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
15882024-12-07T00:48:47.055ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
15892024-12-07T00:48:47.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 941 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38853 req_id = 8d1f3e2c-1f92-4895-be60-e92199f98f46 response_code = 200 uri = /network-bootstore-config
15902024-12-07T00:48:47.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57761
15912024-12-07T00:48:47.063ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15922024-12-07T00:48:47.064ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15932024-12-07T00:48:47.064ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
15942024-12-07T00:48:47.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15952024-12-07T00:48:47.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10577 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45626 req_id = 1481971a-d4d9-4cea-9eef-17ee2da1f031 response_code = 204 uri = /vpc-routes
15962024-12-07T00:48:47.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15972024-12-07T00:48:47.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15982024-12-07T00:48:47.065ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15992024-12-07T00:48:47.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57761 req_id = 73075f29-f877-4947-bf5a-fc3d9c9b8b45 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16002024-12-07T00:48:47.070ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16012024-12-07T00:48:47.070ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f
16022024-12-07T00:48:47.102ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16032024-12-07T00:48:47.102ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8
16042024-12-07T00:48:47.133ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16052024-12-07T00:48:47.133ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37290789-dec6-48b1-bd11-48c109977543
16062024-12-07T00:48:47.143ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16072024-12-07T00:48:47.143ZINFOSledAgent (bootstore): Writing ledger to /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16082024-12-07T00:48:47.145ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16092024-12-07T00:48:47.146ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16102024-12-07T00:48:47.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6513 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38853 req_id = b8f739ef-8e84-4777-851a-a16a105371d0 response_code = 204 uri = /network-bootstore-config
16112024-12-07T00:48:47.179ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16122024-12-07T00:48:47.179ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b
16132024-12-07T00:48:47.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47918
16142024-12-07T00:48:47.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47918 req_id = 6edf3c47-60fb-4fe5-abf8-0768e5ddae1b response_code = 200 uri = /v2p
16152024-12-07T00:48:47.212ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16162024-12-07T00:48:47.212ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14
16172024-12-07T00:48:47.221ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16182024-12-07T00:48:47.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61563 req_id = 86ec722a-df90-4f1d-95d0-f2f3e594f509 response_code = 204 uri = /eip-gateways
16192024-12-07T00:48:47.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40129
16202024-12-07T00:48:47.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16212024-12-07T00:48:47.241ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16222024-12-07T00:48:47.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c
16232024-12-07T00:48:47.271ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16242024-12-07T00:48:47.271ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c
16252024-12-07T00:48:47.277ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16262024-12-07T00:48:47.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16272024-12-07T00:48:47.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7
16282024-12-07T00:48:47.322ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
16292024-12-07T00:48:47.322ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9d33808d-deca-4533-adee-690176030136
16302024-12-07T00:48:47.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284931 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55298 req_id = fb8f36a6-6880-4a38-ab3b-376c980178fb response_code = 200 uri = /inventory
16312024-12-07T00:48:47.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120461 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40129 req_id = 1934c8f8-386c-42a9-9d17-3604f8709b41 response_code = 204 uri = /switch-ports
16322024-12-07T00:48:47.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40129 req_id = 1ec3e18b-e16f-432b-b26c-1a745318e42a response_code = 200 uri = /network-bootstore-config
16332024-12-07T00:48:47.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38627
16342024-12-07T00:48:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38627 req_id = 1633790c-6585-4e98-a693-ee7c2626e079 response_code = 200 uri = /vpc-routes
16352024-12-07T00:48:47.419ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 5 } subnet = RouterId { vni: Vni(100), kind: System }
16362024-12-07T00:48:47.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61563 req_id = df4fae1c-fec1-42d8-a1ef-ad811707ff13 response_code = 204 uri = /vpc-routes
16372024-12-07T00:48:47.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16382024-12-07T00:48:47.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38627 req_id = 710e09b1-4024-4383-a6c3-301e01977681 response_code = 204 uri = /eip-gateways
16392024-12-07T00:48:47.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38627 req_id = f265826d-65dd-43f3-af82-b23851efec1d response_code = 204 uri = /vpc-routes
16402024-12-07T00:48:47.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44081
16412024-12-07T00:48:47.731ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16422024-12-07T00:48:47.731ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16432024-12-07T00:48:47.731ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16442024-12-07T00:48:47.731ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16452024-12-07T00:48:47.732ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16462024-12-07T00:48:47.732ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16472024-12-07T00:48:47.732ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16482024-12-07T00:48:47.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44081 req_id = 76bb39fe-478a-4a77-899d-246652918bb4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16492024-12-07T00:48:47.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45569
16502024-12-07T00:48:47.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45569 req_id = c3175813-d743-4cb7-8194-ba7198575815 response_code = 200 uri = /v2p
16512024-12-07T00:48:47.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56334
16522024-12-07T00:48:47.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16532024-12-07T00:48:47.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16542024-12-07T00:48:47.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101571 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56334 req_id = 5ba9b65e-b8c3-40d2-a336-dcd3febf6c02 response_code = 204 uri = /switch-ports
16552024-12-07T00:48:47.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56334 req_id = 6d24e5ae-38bf-46fc-babc-4af1593413d3 response_code = 200 uri = /network-bootstore-config
16562024-12-07T00:48:55.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53433
16572024-12-07T00:48:55.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53433 req_id = 8f2c98df-71e1-4f4f-a4f0-ce90eebe36ce response_code = 200 uri = /vpc-routes
16582024-12-07T00:48:55.282ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16592024-12-07T00:48:55.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53433 req_id = 13c003bb-89c1-4e9e-b5af-149124f8ca1b response_code = 204 uri = /eip-gateways
16602024-12-07T00:48:55.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53433 req_id = dbd2bbd8-82ba-495e-b4c3-0e8728837b6b response_code = 204 uri = /vpc-routes
16612024-12-07T00:48:56.193ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53707
16622024-12-07T00:48:56.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53707 req_id = d71cea66-10f4-4e3d-89e0-90a2137addbe response_code = 200 uri = /baseboard
16632024-12-07T00:48:57.193ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6974 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = a90cf2d3-815a-4925-8773-6017b2ff19fc response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
16642024-12-07T00:49:16.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61515
16652024-12-07T00:49:16.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61515 req_id = fb242ab3-ce3f-42af-b162-b2e09665d520 response_code = 200 uri = /vpc-routes
16662024-12-07T00:49:16.292ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16672024-12-07T00:49:16.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61515 req_id = e46ed8a1-f542-47f6-b6e0-c92cfbd844e4 response_code = 204 uri = /eip-gateways
16682024-12-07T00:49:16.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61515 req_id = 1d2d9171-b8a8-4325-b0b6-1ff7b4d0dbfe response_code = 204 uri = /vpc-routes
16692024-12-07T00:49:16.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51086
16702024-12-07T00:49:16.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51086 req_id = ff0b48ae-0528-466e-b329-1306c438af14 response_code = 200 uri = /v2p
16712024-12-07T00:49:16.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40977
16722024-12-07T00:49:16.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16732024-12-07T00:49:16.747ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16742024-12-07T00:49:16.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108031 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40977 req_id = a293867e-f56c-4e33-a5fb-9fe7fa14c12a response_code = 204 uri = /switch-ports
16752024-12-07T00:49:16.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40977 req_id = 934fa60f-6ea8-4940-a24a-6ff68de566e0 response_code = 200 uri = /network-bootstore-config
16762024-12-07T00:49:17.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59140
16772024-12-07T00:49:17.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59140 req_id = 8bd19865-9aa2-4307-b849-8e2b32644d77 response_code = 200 uri = /vpc-routes
16782024-12-07T00:49:17.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16792024-12-07T00:49:17.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59140 req_id = 6cce39c0-02c0-478e-a452-42d540c1652c response_code = 204 uri = /eip-gateways
16802024-12-07T00:49:17.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59140 req_id = f3edbc28-1e88-4c08-9d04-565a65dbee6e response_code = 204 uri = /vpc-routes
16812024-12-07T00:49:17.334ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47542
16822024-12-07T00:49:17.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47542 req_id = 412f2f59-1e19-49c6-88ec-c07c42f59121 response_code = 200 uri = /v2p
16832024-12-07T00:49:17.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51429
16842024-12-07T00:49:17.369ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16852024-12-07T00:49:17.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16862024-12-07T00:49:17.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51429 req_id = 43cdc9d5-3677-4031-9aa4-2e48ccb18f0d response_code = 204 uri = /switch-ports
16872024-12-07T00:49:17.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56278
16882024-12-07T00:49:17.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56278 req_id = b771cfd8-8c84-4813-9fd0-9504a07c1cd5 response_code = 200 uri = /vpc-routes
16892024-12-07T00:49:17.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51429 req_id = 3ea6ddbd-c127-4b1c-b510-00bd4c291953 response_code = 200 uri = /network-bootstore-config
16902024-12-07T00:49:17.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
16912024-12-07T00:49:17.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56278 req_id = c4b2b847-4b63-44d1-8171-56c07a7da2aa response_code = 204 uri = /eip-gateways
16922024-12-07T00:49:17.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56278 req_id = 864ef687-7574-4e27-9f84-6636b453e6ec response_code = 204 uri = /vpc-routes
16932024-12-07T00:49:17.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46002
16942024-12-07T00:49:17.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46002 req_id = 1c8f06a1-d84c-4a11-84ef-b89332c1285d response_code = 200 uri = /v2p
16952024-12-07T00:49:17.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58671
16962024-12-07T00:49:17.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
16972024-12-07T00:49:17.769ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
16982024-12-07T00:49:17.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 608dc4a5-4eb6-41d6-b8be-77634ee1e338 response_code = 204 uri = /switch-ports
16992024-12-07T00:49:17.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58671 req_id = 031c4bf4-1312-4e47-986f-15b4b14c6dd4 response_code = 200 uri = /network-bootstore-config
17002024-12-07T00:49:26.228ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53062
17012024-12-07T00:49:26.228ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53062 req_id = 49de7577-84c2-484a-8229-4c417d8e50e0 response_code = 200 uri = /baseboard
17022024-12-07T00:49:27.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7622 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = d4334e89-a721-4599-bfcf-36cd73e6fb2c response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17032024-12-07T00:49:46.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64734
17042024-12-07T00:49:46.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64734 req_id = d39f8208-b3b7-491a-a0f5-bb6c19777c05 response_code = 200 uri = /vpc-routes
17052024-12-07T00:49:46.343ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17062024-12-07T00:49:46.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64734 req_id = 4cc12a97-f4d7-43fd-ae09-4580a482ee61 response_code = 204 uri = /eip-gateways
17072024-12-07T00:49:46.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64734 req_id = e45ed61a-f651-44ae-9bac-e354792871d0 response_code = 204 uri = /vpc-routes
17082024-12-07T00:49:46.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36307
17092024-12-07T00:49:46.389ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17102024-12-07T00:49:46.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17112024-12-07T00:49:46.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91273 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36307 req_id = 0b8e7169-c812-401c-ade9-460ea1bcaf75 response_code = 204 uri = /switch-ports
17122024-12-07T00:49:46.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39641
17132024-12-07T00:49:46.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39641 req_id = 898e4280-1ea8-4491-be8a-da56b2416fe4 response_code = 200 uri = /v2p
17142024-12-07T00:49:46.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36307 req_id = 4a9148ba-eba9-4784-a9d7-03e43c9b8fa6 response_code = 200 uri = /network-bootstore-config
17152024-12-07T00:49:46.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65320
17162024-12-07T00:49:46.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65320 req_id = 2e7bbebd-1e8a-4853-b0a7-18c332ade193 response_code = 200 uri = /vpc-routes
17172024-12-07T00:49:46.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17182024-12-07T00:49:46.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65320 req_id = 7f93bff8-ca2b-47d3-b48d-7e4f02030ff2 response_code = 204 uri = /eip-gateways
17192024-12-07T00:49:47.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61440
17202024-12-07T00:49:47.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61440 req_id = d577564d-0e70-4445-85f4-653b507abc47 response_code = 200 uri = /v2p
17212024-12-07T00:49:47.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65320 req_id = e692a918-c01b-41db-8aa0-883afdae0d3a response_code = 204 uri = /vpc-routes
17222024-12-07T00:49:47.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37174
17232024-12-07T00:49:47.172ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17242024-12-07T00:49:47.220ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17252024-12-07T00:49:47.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37174 req_id = 17f50e37-599b-4d8b-9d22-9e0552a56dd6 response_code = 204 uri = /switch-ports
17262024-12-07T00:49:47.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37174 req_id = 915c2595-742c-4cf7-84b3-9e9b698ba92b response_code = 200 uri = /network-bootstore-config
17272024-12-07T00:49:47.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33980
17282024-12-07T00:49:47.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33980 req_id = e8f07647-f423-44a7-ad46-99018361c6c8 response_code = 200 uri = /vpc-routes
17292024-12-07T00:49:47.404ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17302024-12-07T00:49:47.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33980 req_id = 19bc2362-c332-40f5-b6ca-4e10058f1e36 response_code = 204 uri = /eip-gateways
17312024-12-07T00:49:47.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 683 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33980 req_id = 2ac57b6c-fa59-4295-9676-73460f4674ac response_code = 204 uri = /vpc-routes
17322024-12-07T00:49:47.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33015
17332024-12-07T00:49:47.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33015 req_id = 1ec7c4db-2155-4bfc-92a3-277d7272099c response_code = 200 uri = /v2p
17342024-12-07T00:49:47.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42766
17352024-12-07T00:49:47.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17362024-12-07T00:49:47.589ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17372024-12-07T00:49:47.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90004 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42766 req_id = da7292a2-b4c0-4a6f-95a9-b6ed25cf1d1e response_code = 204 uri = /switch-ports
17382024-12-07T00:49:47.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42766 req_id = 20405af0-1fdd-427f-bfb3-2698e71ec45f response_code = 200 uri = /network-bootstore-config
17392024-12-07T00:49:56.261ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45383
17402024-12-07T00:49:56.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45383 req_id = 130bd40c-701b-41f0-8902-9bf3c2fddb31 response_code = 200 uri = /baseboard
17412024-12-07T00:49:57.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 278d657e-fd09-4c50-b64b-6a6f3db7b99b response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17422024-12-07T00:50:16.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58783
17432024-12-07T00:50:16.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58783 req_id = 464d341a-c356-43e0-bda5-498ddf827031 response_code = 200 uri = /vpc-routes
17442024-12-07T00:50:16.558ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17452024-12-07T00:50:16.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58783 req_id = c70af6a0-a9f7-4b6d-a152-bab0aba51e6a response_code = 204 uri = /eip-gateways
17462024-12-07T00:50:16.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58783 req_id = 6fabd303-9f07-44fc-9568-52639d29a8f6 response_code = 204 uri = /vpc-routes
17472024-12-07T00:50:16.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56337
17482024-12-07T00:50:16.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17492024-12-07T00:50:16.707ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17502024-12-07T00:50:16.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56337 req_id = c5c46374-d485-4bdf-a970-5584e6da20b6 response_code = 204 uri = /switch-ports
17512024-12-07T00:50:16.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53462
17522024-12-07T00:50:16.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53462 req_id = d4ae6773-334e-4225-9304-895b617c3966 response_code = 200 uri = /v2p
17532024-12-07T00:50:16.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56337 req_id = 0a06dbf8-5128-40d1-8cea-a268dc8ea1a1 response_code = 200 uri = /network-bootstore-config
17542024-12-07T00:50:17.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62051
17552024-12-07T00:50:17.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62051 req_id = 6b25417c-ef24-4772-8776-ae16c3b7c1af response_code = 200 uri = /vpc-routes
17562024-12-07T00:50:17.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65299
17572024-12-07T00:50:17.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65299 req_id = aecf2bce-247c-4171-8bb3-5de958f268d3 response_code = 200 uri = /v2p
17582024-12-07T00:50:17.108ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17592024-12-07T00:50:17.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62051 req_id = bec8c723-0986-4aa8-aba8-6dd8d3f67270 response_code = 204 uri = /eip-gateways
17602024-12-07T00:50:17.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62051 req_id = 056e3528-9828-42d2-9454-c7b997471281 response_code = 204 uri = /vpc-routes
17612024-12-07T00:50:17.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59260
17622024-12-07T00:50:17.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17632024-12-07T00:50:17.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17642024-12-07T00:50:17.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59260 req_id = fd361de1-3383-4a91-ae9e-46d58b8a65af response_code = 204 uri = /switch-ports
17652024-12-07T00:50:17.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59260 req_id = b416fa0c-5368-4597-9064-4183e16837b7 response_code = 200 uri = /network-bootstore-config
17662024-12-07T00:50:17.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48569
17672024-12-07T00:50:17.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48569 req_id = bd4fc212-2b7a-418c-8bfd-f5ca9e250fc0 response_code = 200 uri = /vpc-routes
17682024-12-07T00:50:17.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17692024-12-07T00:50:17.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48569 req_id = 49b67847-4525-4564-a155-20bbcb1fc385 response_code = 204 uri = /eip-gateways
17702024-12-07T00:50:17.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48569 req_id = 578e7a66-abe1-414c-9fab-216d9155d8e7 response_code = 204 uri = /vpc-routes
17712024-12-07T00:50:17.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35257
17722024-12-07T00:50:17.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35257 req_id = ec746dac-ae93-40d3-b457-db7713f4e829 response_code = 200 uri = /v2p
17732024-12-07T00:50:17.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46904
17742024-12-07T00:50:17.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17752024-12-07T00:50:17.680ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17762024-12-07T00:50:17.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46904 req_id = 6f2511ee-1e4c-470e-ac2c-6b821ef0de48 response_code = 204 uri = /switch-ports
17772024-12-07T00:50:17.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46904 req_id = ad7f78fc-711a-4395-a3c0-f1a24924700e response_code = 200 uri = /network-bootstore-config
17782024-12-07T00:50:26.296ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52944
17792024-12-07T00:50:26.297ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52944 req_id = 74b5d7b1-8c47-4de3-b0d8-771bb231b83f response_code = 200 uri = /baseboard
17802024-12-07T00:50:27.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7408 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = fbd4846f-9c6b-471d-a7db-433ab1a6c5c7 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
17812024-12-07T00:50:46.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50868
17822024-12-07T00:50:46.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50868 req_id = 6b4a6ebf-41f8-40dd-abe6-21f2389cf507 response_code = 200 uri = /vpc-routes
17832024-12-07T00:50:46.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34051
17842024-12-07T00:50:46.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34051 req_id = fd173a6a-de92-4046-9503-34eaf79952a9 response_code = 200 uri = /v2p
17852024-12-07T00:50:46.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42172
17862024-12-07T00:50:46.457ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
17872024-12-07T00:50:46.495ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
17882024-12-07T00:50:46.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42172 req_id = c2468bbc-96dc-4642-9b9e-7a7a927ca412 response_code = 204 uri = /switch-ports
17892024-12-07T00:50:46.548ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17902024-12-07T00:50:46.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50868 req_id = 0d2a28e0-186c-452f-9a90-6af42f10665f response_code = 204 uri = /eip-gateways
17912024-12-07T00:50:46.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42172 req_id = 6a7804a6-b7ea-4921-97e2-3276644a7d49 response_code = 200 uri = /network-bootstore-config
17922024-12-07T00:50:46.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50868 req_id = d6e816d2-6ad2-4fbe-8668-397cfb2827d7 response_code = 204 uri = /vpc-routes
17932024-12-07T00:50:46.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49115
17942024-12-07T00:50:46.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49115 req_id = f58f6d0b-3f7f-48ad-8a4f-dddeef160227 response_code = 200 uri = /vpc-routes
17952024-12-07T00:50:47.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
17962024-12-07T00:50:47.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49115 req_id = 6ad7616f-886c-44aa-8349-238a6e414401 response_code = 204 uri = /eip-gateways
17972024-12-07T00:50:47.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38494
17982024-12-07T00:50:47.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38494 req_id = 97cc3259-f680-499b-b973-8aa2efb6981b response_code = 200 uri = /v2p
17992024-12-07T00:50:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49115 req_id = df6761d8-22c7-4e7e-b293-1bb4d637a47a response_code = 204 uri = /vpc-routes
18002024-12-07T00:50:47.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65522
18012024-12-07T00:50:47.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18022024-12-07T00:50:47.206ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18032024-12-07T00:50:47.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65522 req_id = 6b056c20-b7ba-4b17-ade5-4fa0909a0f0b response_code = 204 uri = /switch-ports
18042024-12-07T00:50:47.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65522 req_id = 8c946355-6e7b-4751-9372-9be25c57b9fd response_code = 200 uri = /network-bootstore-config
18052024-12-07T00:50:47.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34092
18062024-12-07T00:50:47.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34092 req_id = 2f8de603-1070-4594-9519-46a1cf44284f response_code = 200 uri = /vpc-routes
18072024-12-07T00:50:47.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18082024-12-07T00:50:47.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34092 req_id = 1de68353-ab75-438b-940b-a0a7228e7463 response_code = 204 uri = /eip-gateways
18092024-12-07T00:50:47.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34092 req_id = f79ffbbf-f888-4b1d-9a36-8998ac133a07 response_code = 204 uri = /vpc-routes
18102024-12-07T00:50:47.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36303
18112024-12-07T00:50:47.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36303 req_id = 21b40fcd-22f8-4b9c-8b74-f638deaba633 response_code = 200 uri = /v2p
18122024-12-07T00:50:47.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54184
18132024-12-07T00:50:47.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18142024-12-07T00:50:47.543ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18152024-12-07T00:50:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54184 req_id = 4a50ec2e-5ac8-4c76-87d4-46259db9dd8c response_code = 204 uri = /switch-ports
18162024-12-07T00:50:47.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54184 req_id = 23a49b37-cf26-459c-ab59-f418aba71b5f response_code = 200 uri = /network-bootstore-config
18172024-12-07T00:50:56.330ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52648
18182024-12-07T00:50:56.330ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52648 req_id = f0c5bd22-5cce-410e-a670-1507558bf235 response_code = 200 uri = /baseboard
18192024-12-07T00:50:57.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7589 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 63049b86-07ac-486a-aefd-ae0dbb413e7f response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18202024-12-07T00:51:05.981ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18212024-12-07T00:51:16.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37880
18222024-12-07T00:51:16.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37880 req_id = 3ffba43c-cd73-40e0-9384-d2d9bfb5e383 response_code = 200 uri = /v2p
18232024-12-07T00:51:16.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50967
18242024-12-07T00:51:16.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50967 req_id = 3e88c689-e848-4ac6-ac2a-ff352ac83344 response_code = 200 uri = /vpc-routes
18252024-12-07T00:51:16.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18262024-12-07T00:51:16.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50967 req_id = 4e91c7aa-bee0-485a-8cc2-95fe120e461f response_code = 204 uri = /eip-gateways
18272024-12-07T00:51:16.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50967 req_id = 7d95b341-f315-4cb7-8cfa-9d82e9d6f78e response_code = 204 uri = /vpc-routes
18282024-12-07T00:51:16.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55221
18292024-12-07T00:51:16.714ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18302024-12-07T00:51:16.751ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18312024-12-07T00:51:16.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106459 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55221 req_id = 88f4ec45-d952-4b8e-86fd-7724cd8dd19b response_code = 204 uri = /switch-ports
18322024-12-07T00:51:16.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55221 req_id = 10ad90bc-354c-4626-bc6a-1d4492dc9fde response_code = 200 uri = /network-bootstore-config
18332024-12-07T00:51:17.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43783
18342024-12-07T00:51:17.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43783 req_id = 361a9608-7512-4828-bff9-5707f2a4963c response_code = 200 uri = /v2p
18352024-12-07T00:51:17.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40239
18362024-12-07T00:51:17.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40239 req_id = 2406819c-d2a7-4eb8-84e6-0acda281eaa5 response_code = 200 uri = /vpc-routes
18372024-12-07T00:51:17.281ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18382024-12-07T00:51:17.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40239 req_id = 08fcb692-4ab3-48bd-a1e5-f3b87f183e2d response_code = 204 uri = /eip-gateways
18392024-12-07T00:51:17.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40239 req_id = 1d363b25-f757-4061-8507-7bd62afb0a85 response_code = 204 uri = /vpc-routes
18402024-12-07T00:51:17.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63873
18412024-12-07T00:51:17.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18422024-12-07T00:51:17.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18432024-12-07T00:51:17.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88470 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63873 req_id = 4251c58e-7b5e-408c-a8cb-664defc71df6 response_code = 204 uri = /switch-ports
18442024-12-07T00:51:17.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63873 req_id = 1fbc1856-b2e8-44b9-b01e-c1caeb5f88e0 response_code = 200 uri = /network-bootstore-config
18452024-12-07T00:51:17.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44964
18462024-12-07T00:51:17.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44964 req_id = 7baca03a-3176-4d55-8b93-78b688f0a68e response_code = 200 uri = /v2p
18472024-12-07T00:51:17.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62228
18482024-12-07T00:51:17.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62228 req_id = 7ee2d4b0-71be-428c-a09c-9a142915c29d response_code = 200 uri = /vpc-routes
18492024-12-07T00:51:17.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18502024-12-07T00:51:17.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62228 req_id = 15cdf136-9cbe-4535-b584-9cf01a0b7e22 response_code = 204 uri = /eip-gateways
18512024-12-07T00:51:17.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62228 req_id = cb0ad4e9-d30a-4fe0-948e-599fa0091391 response_code = 204 uri = /vpc-routes
18522024-12-07T00:51:17.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60995
18532024-12-07T00:51:17.710ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18542024-12-07T00:51:17.747ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18552024-12-07T00:51:17.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60995 req_id = 4ddbf715-ff7a-413e-a973-fc713ab6e471 response_code = 204 uri = /switch-ports
18562024-12-07T00:51:17.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60995 req_id = 3d6ea39c-90ad-4528-bd69-a42e50095007 response_code = 200 uri = /network-bootstore-config
18572024-12-07T00:51:26.363ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35988
18582024-12-07T00:51:26.363ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35988 req_id = c188e42e-0906-4c7c-a5d2-1e307e67f0dd response_code = 200 uri = /baseboard
18592024-12-07T00:51:27.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7535 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 0f86944c-209a-4879-8f97-4fa603cc4e84 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18602024-12-07T00:51:46.382ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62366
18612024-12-07T00:51:46.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62366 req_id = 3f93d548-5400-4db4-8909-d219fbee2040 response_code = 200 uri = /vpc-routes
18622024-12-07T00:51:46.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18632024-12-07T00:51:46.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62366 req_id = 25bb6bcd-6664-451b-9034-2216a15be109 response_code = 204 uri = /eip-gateways
18642024-12-07T00:51:46.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49302
18652024-12-07T00:51:46.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49302 req_id = 2b3ebf4e-8cbd-48b1-bb5f-7c40bd3db546 response_code = 200 uri = /v2p
18662024-12-07T00:51:46.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62366 req_id = a5919e01-98c2-4aa3-8ce6-8532e099bc40 response_code = 204 uri = /vpc-routes
18672024-12-07T00:51:46.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35959
18682024-12-07T00:51:46.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18692024-12-07T00:51:46.509ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18702024-12-07T00:51:46.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94201 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35959 req_id = 215a8a2f-0789-4780-b6b0-e96c322fc194 response_code = 204 uri = /switch-ports
18712024-12-07T00:51:46.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35959 req_id = 2df8d0d1-abc8-4ea4-8db7-dc7c4349bb06 response_code = 200 uri = /network-bootstore-config
18722024-12-07T00:51:46.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34500
18732024-12-07T00:51:46.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34500 req_id = e9822b16-b3f4-477e-9a6d-1bfa49c7b553 response_code = 200 uri = /vpc-routes
18742024-12-07T00:51:47.015ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18752024-12-07T00:51:47.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34500 req_id = 4ffcac5a-7e04-4ea5-b327-3d5d680bf19f response_code = 204 uri = /eip-gateways
18762024-12-07T00:51:47.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56810
18772024-12-07T00:51:47.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56810 req_id = 306ea7b3-c7ba-4c87-8425-140ea65b2345 response_code = 200 uri = /v2p
18782024-12-07T00:51:47.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34500 req_id = ef44189e-b699-4d31-8a14-fe2e3b29e089 response_code = 204 uri = /vpc-routes
18792024-12-07T00:51:47.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39616
18802024-12-07T00:51:47.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18812024-12-07T00:51:47.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18822024-12-07T00:51:47.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118426 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39616 req_id = 1fb0253b-4f98-476a-9da7-26f23428178d response_code = 204 uri = /switch-ports
18832024-12-07T00:51:47.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39616 req_id = d503f029-8626-47d1-8086-8b22bd710e1e response_code = 200 uri = /network-bootstore-config
18842024-12-07T00:51:47.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61877
18852024-12-07T00:51:47.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61877 req_id = eff6226c-42a7-427e-a067-3b0b41457af5 response_code = 200 uri = /v2p
18862024-12-07T00:51:47.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42692
18872024-12-07T00:51:47.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42692 req_id = bb445139-6927-441d-bb48-147b67df3971 response_code = 200 uri = /vpc-routes
18882024-12-07T00:51:47.468ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
18892024-12-07T00:51:47.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42692 req_id = 4702aa1d-ed56-4a89-8418-d23f751dae83 response_code = 204 uri = /eip-gateways
18902024-12-07T00:51:47.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42692 req_id = f1d1230f-b689-4131-8ee8-ef7718db38bd response_code = 204 uri = /vpc-routes
18912024-12-07T00:51:47.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58418
18922024-12-07T00:51:47.476ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18932024-12-07T00:51:47.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18942024-12-07T00:51:47.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93020 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58418 req_id = ceeda29e-f369-4ae3-9454-0fa8715d765c response_code = 204 uri = /switch-ports
18952024-12-07T00:51:47.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58418 req_id = f05867a4-c44a-4b58-9026-c0da90735d57 response_code = 200 uri = /network-bootstore-config
18962024-12-07T00:51:56.394ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39224
18972024-12-07T00:51:56.395ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39224 req_id = ea09ea04-d092-4333-aa7c-42c53cfda707 response_code = 200 uri = /baseboard
18982024-12-07T00:51:57.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8482 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 523d8b3b-3655-4d00-a7cf-9cfc026fcee6 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
18992024-12-07T00:52:16.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61321
19002024-12-07T00:52:16.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61321 req_id = 9543a16e-f11a-400b-81e7-bf343e35a98c response_code = 200 uri = /vpc-routes
19012024-12-07T00:52:16.395ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19022024-12-07T00:52:16.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61321 req_id = 3a94d496-c8b3-48e2-9e38-4fe727d92728 response_code = 204 uri = /eip-gateways
19032024-12-07T00:52:16.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61321 req_id = 67574df8-28cd-4b02-aed6-af9d076e58f7 response_code = 204 uri = /vpc-routes
19042024-12-07T00:52:16.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47945
19052024-12-07T00:52:16.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47945 req_id = 0eeca508-bf60-476d-91ad-6d871b5f3d21 response_code = 200 uri = /v2p
19062024-12-07T00:52:16.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33380
19072024-12-07T00:52:16.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19082024-12-07T00:52:16.783ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19092024-12-07T00:52:16.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33380 req_id = 85b065e2-510d-401b-99c7-4d29996cd6dc response_code = 204 uri = /switch-ports
19102024-12-07T00:52:16.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33380 req_id = c93dea95-5d5b-4859-8f4c-d49562105770 response_code = 200 uri = /network-bootstore-config
19112024-12-07T00:52:17.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64525
19122024-12-07T00:52:17.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64525 req_id = f2f2081f-9868-46b3-a773-2245cf834cff response_code = 200 uri = /vpc-routes
19132024-12-07T00:52:17.215ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19142024-12-07T00:52:17.215ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64525 req_id = a32729e8-c762-48ac-b686-cc4d85496d9e response_code = 204 uri = /eip-gateways
19152024-12-07T00:52:17.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64525 req_id = 84a9e27f-1b4d-4e44-8ae3-9c22f981fddd response_code = 204 uri = /vpc-routes
19162024-12-07T00:52:17.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46485
19172024-12-07T00:52:17.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46485 req_id = 34cd818e-9b47-4cb0-bd9c-bf929ee84c9b response_code = 200 uri = /v2p
19182024-12-07T00:52:17.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47653
19192024-12-07T00:52:17.321ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19202024-12-07T00:52:17.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19212024-12-07T00:52:17.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47653 req_id = 752f6b43-b7a4-48fc-a6be-dea536c25ea0 response_code = 204 uri = /switch-ports
19222024-12-07T00:52:17.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61618
19232024-12-07T00:52:17.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61618 req_id = 824e47da-89bf-4692-872a-c379538f9ff2 response_code = 200 uri = /vpc-routes
19242024-12-07T00:52:17.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47653 req_id = 709ce56e-3fa8-4acf-9540-c19616786c2d response_code = 200 uri = /network-bootstore-config
19252024-12-07T00:52:17.491ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19262024-12-07T00:52:17.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61618 req_id = a4a3e0cc-99ec-4c80-bda7-8b08bfb608c7 response_code = 204 uri = /eip-gateways
19272024-12-07T00:52:17.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61618 req_id = 012476a0-1909-428e-b847-ac418e180712 response_code = 204 uri = /vpc-routes
19282024-12-07T00:52:17.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36874
19292024-12-07T00:52:17.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36874 req_id = cb1691ed-97bb-4875-b53f-846f0d6e1a47 response_code = 200 uri = /v2p
19302024-12-07T00:52:17.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46018
19312024-12-07T00:52:17.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19322024-12-07T00:52:17.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19332024-12-07T00:52:17.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88256 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46018 req_id = ea14acf8-e715-4590-8d27-efba42a62117 response_code = 204 uri = /switch-ports
19342024-12-07T00:52:17.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46018 req_id = 85ab4835-0559-4255-bd5d-aa36e9dee35f response_code = 200 uri = /network-bootstore-config
19352024-12-07T00:52:26.427ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35740
19362024-12-07T00:52:26.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35740 req_id = aeae7dac-6b19-4f0f-aec4-2a61fcd4c40f response_code = 200 uri = /baseboard
19372024-12-07T00:52:27.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8220 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 5e90655b-8385-4b2d-ac9c-beca40d6ebc8 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
19382024-12-07T00:52:46.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47266
19392024-12-07T00:52:46.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47266 req_id = 3ecbd662-278c-433f-8af1-aa86f9126b15 response_code = 200 uri = /v2p
19402024-12-07T00:52:46.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45094
19412024-12-07T00:52:46.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45094 req_id = 58c04085-51a1-4a8f-8ee4-2455d4a1ba40 response_code = 200 uri = /vpc-routes
19422024-12-07T00:52:46.407ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19432024-12-07T00:52:46.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45094 req_id = 96502ed7-2eeb-4d40-ac7e-829ac444de83 response_code = 204 uri = /eip-gateways
19442024-12-07T00:52:46.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45094 req_id = aafcc0e3-9049-45d1-b425-179226c91762 response_code = 204 uri = /vpc-routes
19452024-12-07T00:52:46.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64502
19462024-12-07T00:52:46.491ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19472024-12-07T00:52:46.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19482024-12-07T00:52:46.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88800 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64502 req_id = 29391077-6590-4601-9b54-e7e3bed533f3 response_code = 204 uri = /switch-ports
19492024-12-07T00:52:46.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64502 req_id = 6ae1f706-1ea0-43db-8cf1-cf7b03e4ab22 response_code = 200 uri = /network-bootstore-config
19502024-12-07T00:52:46.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38119
19512024-12-07T00:52:46.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38119 req_id = f11747d0-deb1-4215-8845-fb2ae0a63c66 response_code = 200 uri = /vpc-routes
19522024-12-07T00:52:47.031ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19532024-12-07T00:52:47.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38119 req_id = 20ecb609-c774-4831-8916-15c7d3ab1edc response_code = 204 uri = /eip-gateways
19542024-12-07T00:52:47.049ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42837
19552024-12-07T00:52:47.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42837 req_id = ac403cd4-172a-49b0-afc9-9862326e67f5 response_code = 200 uri = /v2p
19562024-12-07T00:52:47.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38119 req_id = 8d2f8bb9-ba79-4f0a-9449-a6a7cbc58b9f response_code = 204 uri = /vpc-routes
19572024-12-07T00:52:47.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35958
19582024-12-07T00:52:47.101ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19592024-12-07T00:52:47.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19602024-12-07T00:52:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35958 req_id = 5610403e-f437-4787-8664-373cb5936d96 response_code = 204 uri = /switch-ports
19612024-12-07T00:52:47.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35958 req_id = 0a58ed90-ef07-41c7-9e54-4474a0269816 response_code = 200 uri = /network-bootstore-config
19622024-12-07T00:52:47.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64868
19632024-12-07T00:52:47.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64868 req_id = 9c82bccb-61b4-466b-a7af-91e0a296e9cd response_code = 200 uri = /vpc-routes
19642024-12-07T00:52:47.369ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19652024-12-07T00:52:47.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64868 req_id = 2f3f9955-a4fa-4e15-8065-60119445eb02 response_code = 204 uri = /eip-gateways
19662024-12-07T00:52:47.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64868 req_id = 8528d309-1829-4906-9281-5047b7b40d00 response_code = 204 uri = /vpc-routes
19672024-12-07T00:52:47.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37448
19682024-12-07T00:52:47.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37448 req_id = 8c6e5758-2da7-4c95-ab4e-4ba0194bfdf2 response_code = 200 uri = /v2p
19692024-12-07T00:52:47.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35478
19702024-12-07T00:52:47.463ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19712024-12-07T00:52:47.514ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19722024-12-07T00:52:47.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35478 req_id = 392d257a-afca-42aa-a5e6-5b086e14e09b response_code = 204 uri = /switch-ports
19732024-12-07T00:52:47.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35478 req_id = 54171895-5e25-40cf-8351-618832951a18 response_code = 200 uri = /network-bootstore-config
19742024-12-07T00:52:56.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36370
19752024-12-07T00:52:56.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36370 req_id = 97491fd5-bfb5-43da-9bbf-d9e9fed816d9 response_code = 200 uri = /baseboard
19762024-12-07T00:52:57.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7619 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = f3f1aadd-74f4-44e8-b1ec-b183d332b035 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
19772024-12-07T00:53:16.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58044
19782024-12-07T00:53:16.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58044 req_id = c3263a52-904c-4ac1-a7b6-0212669d8ad8 response_code = 200 uri = /vpc-routes
19792024-12-07T00:53:16.520ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
19802024-12-07T00:53:16.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58044 req_id = d793a338-3c72-46d8-8332-4f19e73c40ef response_code = 204 uri = /eip-gateways
19812024-12-07T00:53:16.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58044 req_id = f5b4cc27-8b4e-4a16-bf8f-6c9c828c12d1 response_code = 204 uri = /vpc-routes
19822024-12-07T00:53:16.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58521
19832024-12-07T00:53:16.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58521 req_id = 64496b5a-e78a-4a92-956c-2c00d1f37c0c response_code = 200 uri = /v2p
19842024-12-07T00:53:16.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40699
19852024-12-07T00:53:16.777ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19862024-12-07T00:53:16.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19872024-12-07T00:53:16.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138933 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40699 req_id = 27053f88-6d8e-4179-8edb-8f7593ca1c8e response_code = 204 uri = /switch-ports
19882024-12-07T00:53:16.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40699 req_id = 422b6aeb-42e1-4c22-821d-63811b9ffb88 response_code = 200 uri = /network-bootstore-config
19892024-12-07T00:53:16.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47831
19902024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19912024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19922024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19932024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19942024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19952024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19962024-12-07T00:53:16.927ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19972024-12-07T00:53:16.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47831 req_id = a7dcd0db-87a8-47de-b444-46ffe27fec89 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19982024-12-07T00:53:17.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50780
19992024-12-07T00:53:17.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50780 req_id = 98698bfb-cab9-45b8-8406-db7b9cfabc0c response_code = 200 uri = /v2p
20002024-12-07T00:53:17.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47899
20012024-12-07T00:53:17.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47899 req_id = fdf40587-9d82-4a7c-946e-c83ab186ca27 response_code = 200 uri = /vpc-routes
20022024-12-07T00:53:17.279ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20032024-12-07T00:53:17.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47899 req_id = c8a00d76-525a-4f45-bf0d-24b8faf1bfbd response_code = 204 uri = /eip-gateways
20042024-12-07T00:53:17.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47899 req_id = 827d5885-c748-4fee-8f38-67c8e05c6d10 response_code = 204 uri = /vpc-routes
20052024-12-07T00:53:17.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40920
20062024-12-07T00:53:17.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40920 req_id = 4b7e8bfa-f203-4645-a5a0-a464b0e1b4d6 response_code = 200 uri = /vpc-routes
20072024-12-07T00:53:17.442ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20082024-12-07T00:53:17.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40920 req_id = 0ad72aec-1f9a-4f61-bd5c-33a7712e3775 response_code = 204 uri = /eip-gateways
20092024-12-07T00:53:17.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40920 req_id = 08fe61cd-ed3e-4f89-92f8-e0b2fcba7cec response_code = 204 uri = /vpc-routes
20102024-12-07T00:53:17.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56124
20112024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20122024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20132024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20142024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20152024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20162024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20172024-12-07T00:53:17.489ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20182024-12-07T00:53:17.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56124 req_id = 755f85a1-35c7-41a3-9df5-d02e3d29c321 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20192024-12-07T00:53:17.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36082
20202024-12-07T00:53:17.496ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20212024-12-07T00:53:17.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20222024-12-07T00:53:17.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36082 req_id = 9f32bd5f-0bf1-4e08-a4af-d592d7be3c55 response_code = 204 uri = /switch-ports
20232024-12-07T00:53:17.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61501
20242024-12-07T00:53:17.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61501 req_id = e57c151e-1660-43e3-bfdc-adc8262feba2 response_code = 200 uri = /v2p
20252024-12-07T00:53:17.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36082 req_id = 9f9d5c4a-c27b-4046-90ba-402995c56ccc response_code = 200 uri = /network-bootstore-config
20262024-12-07T00:53:17.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60555
20272024-12-07T00:53:17.604ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20282024-12-07T00:53:17.638ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20292024-12-07T00:53:17.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60555 req_id = 322b5c2c-7666-4a87-aef6-deec16e1b10c response_code = 204 uri = /switch-ports
20302024-12-07T00:53:17.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40789
20312024-12-07T00:53:17.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60555 req_id = 24f88b59-7304-491f-94ba-4ebac4166e16 response_code = 200 uri = /network-bootstore-config
20322024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20332024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20342024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20352024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20362024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20372024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20382024-12-07T00:53:17.690ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20392024-12-07T00:53:17.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40789 req_id = 713dfc29-618b-47d4-be4e-8b0fdc413518 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20402024-12-07T00:53:26.492ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34887
20412024-12-07T00:53:26.492ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34887 req_id = 5c7f7f9d-6d3b-4896-a69b-c7a154e559dc response_code = 200 uri = /baseboard
20422024-12-07T00:53:27.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7834 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 5dfa2349-d99a-4b08-8c01-7ef5d23972cf response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
20432024-12-07T00:53:46.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42024
20442024-12-07T00:53:46.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42024 req_id = 59866606-7ea9-4876-a62a-e91f7f78efed response_code = 200 uri = /v2p
20452024-12-07T00:53:46.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56889
20462024-12-07T00:53:46.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56889 req_id = 75c0f9fe-74c9-4f46-9860-2e00547d6357 response_code = 200 uri = /vpc-routes
20472024-12-07T00:53:46.492ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20482024-12-07T00:53:46.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56889 req_id = b03a2a51-a988-416d-940c-4dae3bccaf61 response_code = 204 uri = /eip-gateways
20492024-12-07T00:53:46.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56889 req_id = 0878db0a-5183-4e5f-8407-16fd8de8efcb response_code = 204 uri = /vpc-routes
20502024-12-07T00:53:46.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36677
20512024-12-07T00:53:46.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20522024-12-07T00:53:46.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20532024-12-07T00:53:46.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36677 req_id = f1d9b85f-ef23-407f-b5ad-7b5cf6d1ac9f response_code = 204 uri = /switch-ports
20542024-12-07T00:53:46.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36677 req_id = 990cb015-926e-4308-bae5-f91e304c33d4 response_code = 200 uri = /network-bootstore-config
20552024-12-07T00:53:46.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49689
20562024-12-07T00:53:46.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49689 req_id = 02d26ba0-b6af-4910-897f-823ae3dc2244 response_code = 200 uri = /vpc-routes
20572024-12-07T00:53:46.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20582024-12-07T00:53:46.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49689 req_id = 8a44aa4b-7bbd-40b6-ae79-5cd220cb7a92 response_code = 204 uri = /eip-gateways
20592024-12-07T00:53:46.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49689 req_id = 16d8d46c-3d1e-4bb3-bfad-c9c523a28cef response_code = 204 uri = /vpc-routes
20602024-12-07T00:53:46.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55434
20612024-12-07T00:53:46.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55434 req_id = e59434d7-d79e-4164-bbcf-ac72568e3458 response_code = 200 uri = /v2p
20622024-12-07T00:53:47.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55379
20632024-12-07T00:53:47.022ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20642024-12-07T00:53:47.060ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20652024-12-07T00:53:47.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92393 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55379 req_id = a7566037-6e7e-446f-9a16-a4a17401daab response_code = 204 uri = /switch-ports
20662024-12-07T00:53:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55379 req_id = b8365352-615e-4b28-8b70-840bf3dfb29b response_code = 200 uri = /network-bootstore-config
20672024-12-07T00:53:47.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48083
20682024-12-07T00:53:47.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48083 req_id = 6c6ad4d5-99af-4530-a508-09efef9b0e34 response_code = 200 uri = /vpc-routes
20692024-12-07T00:53:47.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20702024-12-07T00:53:47.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48083 req_id = a9430616-e690-4283-bf05-2593bf4d0c21 response_code = 204 uri = /eip-gateways
20712024-12-07T00:53:47.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48083 req_id = 49005325-e9d9-4c44-a7e2-c51da360eb35 response_code = 204 uri = /vpc-routes
20722024-12-07T00:53:47.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43885
20732024-12-07T00:53:47.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43885 req_id = 68f26696-b40e-4d91-8a31-5cb128c59526 response_code = 200 uri = /v2p
20742024-12-07T00:53:47.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47578
20752024-12-07T00:53:47.492ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20762024-12-07T00:53:47.529ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20772024-12-07T00:53:47.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89971 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47578 req_id = 3ed1eec8-687f-484d-888c-3bc4e5e32bde response_code = 204 uri = /switch-ports
20782024-12-07T00:53:47.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47578 req_id = fe4a53a2-a3ab-4c7d-b6e5-baee32a31fb1 response_code = 200 uri = /network-bootstore-config
20792024-12-07T00:53:56.525ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62454
20802024-12-07T00:53:56.525ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62454 req_id = 5e2a14d6-fe18-4f97-a25c-1f0999386729 response_code = 200 uri = /baseboard
20812024-12-07T00:53:57.200ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11905 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 2688d13c-a6d4-4efd-ae97-03bc8935018b response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
20822024-12-07T00:54:16.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65023
20832024-12-07T00:54:16.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65023 req_id = c3099422-8f19-4c62-b183-6a97090a32fd response_code = 200 uri = /vpc-routes
20842024-12-07T00:54:16.660ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20852024-12-07T00:54:16.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65023 req_id = 0ff8046a-3a50-42ed-9045-a6530a565e90 response_code = 204 uri = /eip-gateways
20862024-12-07T00:54:16.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39522
20872024-12-07T00:54:16.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39522 req_id = 7f5f70d0-a250-48ea-9147-87e2cb013b19 response_code = 200 uri = /v2p
20882024-12-07T00:54:16.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65023 req_id = a25bc97a-5cee-4a6f-9ac7-f28132e88602 response_code = 204 uri = /vpc-routes
20892024-12-07T00:54:16.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43318
20902024-12-07T00:54:16.685ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20912024-12-07T00:54:16.718ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20922024-12-07T00:54:16.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92939 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43318 req_id = 8954b394-ddae-4a71-9bf9-a7fae18c1ce1 response_code = 204 uri = /switch-ports
20932024-12-07T00:54:16.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43318 req_id = 89f19178-33e9-42dd-a202-7a301f19bfac response_code = 200 uri = /network-bootstore-config
20942024-12-07T00:54:17.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43600
20952024-12-07T00:54:17.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43600 req_id = 1cefefaa-003d-4980-b972-39246a849f80 response_code = 200 uri = /vpc-routes
20962024-12-07T00:54:17.280ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
20972024-12-07T00:54:17.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43600 req_id = 9ef308a6-f223-40d3-ba86-12e62d3f529c response_code = 204 uri = /eip-gateways
20982024-12-07T00:54:17.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43600 req_id = 59566e5c-2f03-4194-86ac-b7fd1e7bb3e1 response_code = 204 uri = /vpc-routes
20992024-12-07T00:54:17.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47268
21002024-12-07T00:54:17.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47268 req_id = ca44edea-73b6-46a0-ad61-51f2687204e4 response_code = 200 uri = /v2p
21012024-12-07T00:54:17.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41137
21022024-12-07T00:54:17.338ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21032024-12-07T00:54:17.375ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21042024-12-07T00:54:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41137 req_id = 261666f6-8d48-4686-8c7e-ad318afba23e response_code = 204 uri = /switch-ports
21052024-12-07T00:54:17.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41137 req_id = c0dccb5c-f411-4d40-b087-220ebf3c3c18 response_code = 200 uri = /network-bootstore-config
21062024-12-07T00:54:17.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38652
21072024-12-07T00:54:17.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38652 req_id = 6669560b-6912-4e27-ae71-e17731877370 response_code = 200 uri = /v2p
21082024-12-07T00:54:17.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56725
21092024-12-07T00:54:17.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56725 req_id = 6fd7441a-ab33-444f-857d-22d77d838591 response_code = 200 uri = /vpc-routes
21102024-12-07T00:54:17.679ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21112024-12-07T00:54:17.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56725 req_id = 070b5d5d-4af7-4df0-9be4-9a2277dfa243 response_code = 204 uri = /eip-gateways
21122024-12-07T00:54:17.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56725 req_id = 9b3e5bef-c461-4dfc-a9e2-c0df3d72f2b2 response_code = 204 uri = /vpc-routes
21132024-12-07T00:54:17.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36586
21142024-12-07T00:54:17.697ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21152024-12-07T00:54:17.734ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21162024-12-07T00:54:17.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36586 req_id = 3f132dc1-ad34-4972-92e2-36be9f6a4a32 response_code = 204 uri = /switch-ports
21172024-12-07T00:54:17.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36586 req_id = b3902c3d-1a1d-4227-8a98-6cb10dbcdfd7 response_code = 200 uri = /network-bootstore-config
21182024-12-07T00:54:26.559ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38458
21192024-12-07T00:54:26.559ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38458 req_id = 7d512eba-0139-444b-9948-0a788c4201f0 response_code = 200 uri = /baseboard
21202024-12-07T00:54:27.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7142 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 3a87fa26-883e-45f7-a423-ebc6c501b9c8 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21212024-12-07T00:54:46.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61319
21222024-12-07T00:54:46.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61319 req_id = c55e9a42-d820-4733-bad9-c64def961413 response_code = 200 uri = /vpc-routes
21232024-12-07T00:54:46.381ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21242024-12-07T00:54:46.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61319 req_id = 6944c843-72e7-41b5-919e-55a934b841cf response_code = 204 uri = /eip-gateways
21252024-12-07T00:54:46.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61319 req_id = f405ff87-aa68-4e5d-b8e7-25e014782ead response_code = 204 uri = /vpc-routes
21262024-12-07T00:54:46.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40728
21272024-12-07T00:54:46.410ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21282024-12-07T00:54:46.449ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21292024-12-07T00:54:46.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40728 req_id = d0958b4e-b328-4fa8-9540-edbe48c50123 response_code = 204 uri = /switch-ports
21302024-12-07T00:54:46.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40728 req_id = 217d1b2a-a437-47d6-9544-12ea91194751 response_code = 200 uri = /network-bootstore-config
21312024-12-07T00:54:46.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39418
21322024-12-07T00:54:46.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39418 req_id = c74fa333-1ca0-43d7-8c39-5c245f2a4d06 response_code = 200 uri = /v2p
21332024-12-07T00:54:46.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59148
21342024-12-07T00:54:46.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59148 req_id = a00f86a8-06a9-4e67-b45c-c38c859c0ef7 response_code = 200 uri = /vpc-routes
21352024-12-07T00:54:46.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21362024-12-07T00:54:46.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59148 req_id = 9d271839-53c5-4060-a053-89d54e0d5a57 response_code = 204 uri = /eip-gateways
21372024-12-07T00:54:46.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59148 req_id = d795ba9e-7554-4f69-912d-9e9892dea958 response_code = 204 uri = /vpc-routes
21382024-12-07T00:54:47.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54969
21392024-12-07T00:54:47.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54969 req_id = 68a9191c-00bf-46b6-8842-7149fb377cbf response_code = 200 uri = /v2p
21402024-12-07T00:54:47.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40069
21412024-12-07T00:54:47.068ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21422024-12-07T00:54:47.104ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21432024-12-07T00:54:47.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40069 req_id = 9ff01dad-2dec-47da-8a64-60edbb74449a response_code = 204 uri = /switch-ports
21442024-12-07T00:54:47.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40069 req_id = 3bfc97f7-ee4a-4242-97f4-423796a1c6dc response_code = 200 uri = /network-bootstore-config
21452024-12-07T00:54:47.332ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39916
21462024-12-07T00:54:47.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39916 req_id = 49d008eb-6e2e-4475-93bd-8892e5297695 response_code = 200 uri = /vpc-routes
21472024-12-07T00:54:47.375ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21482024-12-07T00:54:47.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39916 req_id = 7b31cbef-4143-4c19-809b-4ddff511fbd4 response_code = 204 uri = /eip-gateways
21492024-12-07T00:54:47.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39916 req_id = 4b5b3daf-89a3-4502-be13-d817d491898d response_code = 204 uri = /vpc-routes
21502024-12-07T00:54:47.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33219
21512024-12-07T00:54:47.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33219 req_id = 403ec42b-0e62-435a-a630-3a8f8c0e32b9 response_code = 200 uri = /v2p
21522024-12-07T00:54:47.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38935
21532024-12-07T00:54:47.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21542024-12-07T00:54:47.486ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21552024-12-07T00:54:47.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38935 req_id = 01ef574f-d261-4635-b50f-694c5e61234f response_code = 204 uri = /switch-ports
21562024-12-07T00:54:47.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38935 req_id = a791ee2d-b8bb-4bf1-9dcf-5fe668792785 response_code = 200 uri = /network-bootstore-config
21572024-12-07T00:54:56.592ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58763
21582024-12-07T00:54:56.592ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58763 req_id = 430c8c5d-b77f-419c-997c-906e3b6c36e1 response_code = 200 uri = /baseboard
21592024-12-07T00:54:57.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7912 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = f3e7be6f-4f28-4f7c-bb80-cb0e74f8e6b9 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21602024-12-07T00:55:16.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48172
21612024-12-07T00:55:16.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48172 req_id = 117be8b5-9092-4079-b4f8-21de2a4d52cc response_code = 200 uri = /vpc-routes
21622024-12-07T00:55:16.436ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21632024-12-07T00:55:16.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48172 req_id = 58580b26-d400-4522-9129-55d6da8101b6 response_code = 204 uri = /eip-gateways
21642024-12-07T00:55:16.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48172 req_id = b0344cc9-274b-47b0-8241-503a9a21ade1 response_code = 204 uri = /vpc-routes
21652024-12-07T00:55:16.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36656
21662024-12-07T00:55:16.628ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36656 req_id = 2fdea8c2-d086-4921-b7de-9285dd977598 response_code = 200 uri = /v2p
21672024-12-07T00:55:16.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63861
21682024-12-07T00:55:16.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21692024-12-07T00:55:16.676ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21702024-12-07T00:55:16.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63861 req_id = 9322011a-6ddb-4e20-9ee3-a0d7985a9cdc response_code = 204 uri = /switch-ports
21712024-12-07T00:55:16.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63861 req_id = 3ace18c9-6935-4ba9-9ec9-3c7dde2ff8a1 response_code = 200 uri = /network-bootstore-config
21722024-12-07T00:55:17.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39223
21732024-12-07T00:55:17.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39223 req_id = 5cc7d90b-4d19-4efd-9c41-ab27400a0eb6 response_code = 200 uri = /vpc-routes
21742024-12-07T00:55:17.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21752024-12-07T00:55:17.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39223 req_id = b352c655-d431-4499-8e13-8e5dbdb2991b response_code = 204 uri = /eip-gateways
21762024-12-07T00:55:17.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39223 req_id = 5b173ddb-1ce8-4edb-ab76-5c0983c1a278 response_code = 204 uri = /vpc-routes
21772024-12-07T00:55:17.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40745
21782024-12-07T00:55:17.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40745 req_id = 6e4703cc-874e-4d84-9fc5-3dd805f116cb response_code = 200 uri = /v2p
21792024-12-07T00:55:17.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47768
21802024-12-07T00:55:17.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21812024-12-07T00:55:17.330ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21822024-12-07T00:55:17.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89623 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47768 req_id = 0ebb8781-44a0-48a2-9ace-25f6fa1540a3 response_code = 204 uri = /switch-ports
21832024-12-07T00:55:17.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47768 req_id = f021e187-1140-4393-abc2-292e8b7d17ef response_code = 200 uri = /network-bootstore-config
21842024-12-07T00:55:17.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61114
21852024-12-07T00:55:17.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61114 req_id = 75f79c04-688a-4e01-8a5a-246082916964 response_code = 200 uri = /vpc-routes
21862024-12-07T00:55:17.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37020
21872024-12-07T00:55:17.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37020 req_id = 751f9af3-d9db-4aea-a548-c3f9c896a91d response_code = 200 uri = /v2p
21882024-12-07T00:55:17.463ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
21892024-12-07T00:55:17.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61114 req_id = 586a0016-dbcb-470e-83b2-1d6398819455 response_code = 204 uri = /eip-gateways
21902024-12-07T00:55:17.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61114 req_id = 7300d10b-53be-4b6d-95a3-0e9c8adbc145 response_code = 204 uri = /vpc-routes
21912024-12-07T00:55:17.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56702
21922024-12-07T00:55:17.591ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21932024-12-07T00:55:17.626ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21942024-12-07T00:55:17.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88891 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56702 req_id = a813aa80-0550-42b8-828d-a3a72fe816c0 response_code = 204 uri = /switch-ports
21952024-12-07T00:55:17.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56702 req_id = 0a74892a-5e67-480b-8d71-d6133d2d5834 response_code = 200 uri = /network-bootstore-config
21962024-12-07T00:55:26.624ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34546
21972024-12-07T00:55:26.624ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34546 req_id = 10ff0bdb-86f8-4da3-9c29-0634dd6f6cd7 response_code = 200 uri = /baseboard
21982024-12-07T00:55:27.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7853 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 43c5fc78-dea4-4c95-9472-af4a05aa40b9 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
21992024-12-07T00:55:46.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52645
22002024-12-07T00:55:46.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52645 req_id = 64097084-9757-4e13-9aea-9875217b73a4 response_code = 200 uri = /vpc-routes
22012024-12-07T00:55:46.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22022024-12-07T00:55:46.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52645 req_id = 11b7a2c4-31a2-4c8b-83f2-b0de76ce5b77 response_code = 204 uri = /eip-gateways
22032024-12-07T00:55:46.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64012
22042024-12-07T00:55:46.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64012 req_id = 8661bd93-0cdd-4018-b728-760961fdfc1c response_code = 200 uri = /v2p
22052024-12-07T00:55:46.417ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52645 req_id = 997bd79e-20b5-4b78-ab0a-f03dd5eb0288 response_code = 204 uri = /vpc-routes
22062024-12-07T00:55:46.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39966
22072024-12-07T00:55:46.519ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22082024-12-07T00:55:46.553ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22092024-12-07T00:55:46.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39966 req_id = db3d781e-1759-47c6-86e1-3a7e98ded327 response_code = 204 uri = /switch-ports
22102024-12-07T00:55:46.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39966 req_id = deaf1881-293b-45b7-a874-43f6902fce44 response_code = 200 uri = /network-bootstore-config
22112024-12-07T00:55:46.950ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53862
22122024-12-07T00:55:46.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53862 req_id = 1180c045-83e7-4e76-9d95-47cba61f10ce response_code = 200 uri = /vpc-routes
22132024-12-07T00:55:46.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22142024-12-07T00:55:46.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53862 req_id = 7bd6f30c-ea0d-4652-b1e2-db6b0b505c62 response_code = 204 uri = /eip-gateways
22152024-12-07T00:55:46.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53862 req_id = e0ac041e-43be-42ce-98e3-86a3b3f6160b response_code = 204 uri = /vpc-routes
22162024-12-07T00:55:47.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58591
22172024-12-07T00:55:47.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58591 req_id = 6d1c0af4-f4f6-4747-bd84-26ea326e392c response_code = 200 uri = /v2p
22182024-12-07T00:55:47.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56948
22192024-12-07T00:55:47.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22202024-12-07T00:55:47.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22212024-12-07T00:55:47.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56948 req_id = bcf13a15-dde0-4f0b-bcd2-3fa4b2795e46 response_code = 204 uri = /switch-ports
22222024-12-07T00:55:47.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56948 req_id = 82874f34-7940-4505-8030-320a5307104f response_code = 200 uri = /network-bootstore-config
22232024-12-07T00:55:47.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42361
22242024-12-07T00:55:47.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42361 req_id = 51d5ae97-a507-4e95-9dc0-b119ba45ceaf response_code = 200 uri = /vpc-routes
22252024-12-07T00:55:47.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64336
22262024-12-07T00:55:47.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64336 req_id = 41d4e934-37a9-4a4d-8214-f8c23b1550ba response_code = 200 uri = /v2p
22272024-12-07T00:55:47.505ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22282024-12-07T00:55:47.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42361 req_id = 56eb51c5-6993-4e77-a348-4c6195989ecf response_code = 204 uri = /eip-gateways
22292024-12-07T00:55:47.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42361 req_id = 8ad2ccb2-3212-48a2-9a52-33734da54fa1 response_code = 204 uri = /vpc-routes
22302024-12-07T00:55:47.533ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51928
22312024-12-07T00:55:47.533ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22322024-12-07T00:55:47.566ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22332024-12-07T00:55:47.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84111 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51928 req_id = 584603bd-e5b6-44e2-8abd-d84bf582e1dc response_code = 204 uri = /switch-ports
22342024-12-07T00:55:47.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51928 req_id = cb8c4f46-8eb9-4b18-b993-ad3fb4aba817 response_code = 200 uri = /network-bootstore-config
22352024-12-07T00:55:51.307ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22362024-12-07T00:55:51.307ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
22372024-12-07T00:55:51.342ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 4814, tv_nsec: 566950447 } time_to_next_cleanup = 599.999997829s
22382024-12-07T00:55:56.659ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35198
22392024-12-07T00:55:56.659ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35198 req_id = 6d9c91c0-af58-4b68-87b6-8518924eff1e response_code = 200 uri = /baseboard
22402024-12-07T00:55:57.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7705 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 72d89449-783d-4870-a596-59a38bc18c16 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
22412024-12-07T00:56:05.982ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22422024-12-07T00:56:16.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57309
22432024-12-07T00:56:16.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57309 req_id = 9e46c71c-ece7-4f98-839f-aef5468b6182 response_code = 200 uri = /vpc-routes
22442024-12-07T00:56:16.456ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22452024-12-07T00:56:16.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57309 req_id = 8b531396-8826-4c23-8db1-e275f8a5446a response_code = 204 uri = /eip-gateways
22462024-12-07T00:56:16.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57309 req_id = c1984e3e-67b5-44d8-99fc-95db1d85c7db response_code = 204 uri = /vpc-routes
22472024-12-07T00:56:16.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54303
22482024-12-07T00:56:16.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54303 req_id = 9b5cede3-c04b-4934-b0f9-4b89b0e78caa response_code = 200 uri = /v2p
22492024-12-07T00:56:16.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56726
22502024-12-07T00:56:16.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22512024-12-07T00:56:16.678ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22522024-12-07T00:56:16.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86407 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56726 req_id = c278272e-adb4-40d0-a681-4badfb03c120 response_code = 204 uri = /switch-ports
22532024-12-07T00:56:16.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56726 req_id = d1db00f3-6de8-4b90-9df7-bdb4af0ab65c response_code = 200 uri = /network-bootstore-config
22542024-12-07T00:56:16.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58949
22552024-12-07T00:56:16.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58949 req_id = 721ca77d-2b03-419b-9785-59a55320c5fc response_code = 200 uri = /vpc-routes
22562024-12-07T00:56:17.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22572024-12-07T00:56:17.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58949 req_id = 09dc4f9a-b645-4122-b088-59c912d82d38 response_code = 204 uri = /eip-gateways
22582024-12-07T00:56:17.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58949 req_id = cabe261e-1e6e-4d36-a1df-f53a17cc8131 response_code = 204 uri = /vpc-routes
22592024-12-07T00:56:17.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51674
22602024-12-07T00:56:17.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51674 req_id = 3cca5564-3bd7-4b27-9672-67465648aac5 response_code = 200 uri = /v2p
22612024-12-07T00:56:17.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38100
22622024-12-07T00:56:17.309ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22632024-12-07T00:56:17.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22642024-12-07T00:56:17.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38100 req_id = 805da544-94be-4a9f-a046-ca7805c0ff2e response_code = 204 uri = /switch-ports
22652024-12-07T00:56:17.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53339
22662024-12-07T00:56:17.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53339 req_id = 343fb75b-b080-4bfc-9e3d-567ed31f1a8e response_code = 200 uri = /vpc-routes
22672024-12-07T00:56:17.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38100 req_id = 06850808-1a5e-4aac-9221-42c9010f4e77 response_code = 200 uri = /network-bootstore-config
22682024-12-07T00:56:17.461ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22692024-12-07T00:56:17.461ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53339 req_id = fb81f107-c485-4c4a-b461-f6b527570fb1 response_code = 204 uri = /eip-gateways
22702024-12-07T00:56:17.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53339 req_id = 71b257cb-b119-4716-8641-4f3af1e9ba03 response_code = 204 uri = /vpc-routes
22712024-12-07T00:56:17.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63096
22722024-12-07T00:56:17.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63096 req_id = 2d44a126-3ce4-412b-b4c4-06dfcf0cdbc2 response_code = 200 uri = /v2p
22732024-12-07T00:56:17.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61104
22742024-12-07T00:56:17.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22752024-12-07T00:56:17.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22762024-12-07T00:56:17.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89936 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61104 req_id = 9eafec22-dbc1-488d-94d2-4c82b71f7813 response_code = 204 uri = /switch-ports
22772024-12-07T00:56:17.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61104 req_id = 626c103e-236e-43cf-bb8a-42acb590f8e5 response_code = 200 uri = /network-bootstore-config
22782024-12-07T00:56:26.691ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45220
22792024-12-07T00:56:26.691ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45220 req_id = 01b86a36-4518-4f4f-91c2-13fa04c2d838 response_code = 200 uri = /baseboard
22802024-12-07T00:56:27.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7590 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 319a4113-01d6-474b-809d-41b25402c871 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
22812024-12-07T00:56:46.302ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44399
22822024-12-07T00:56:46.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44399 req_id = 9bf9e8b3-3a56-4a27-bdda-d3b090f5298f response_code = 200 uri = /vpc-routes
22832024-12-07T00:56:46.345ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22842024-12-07T00:56:46.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44399 req_id = 5578e989-78f7-4ca7-aa67-e8580ac2a3f3 response_code = 204 uri = /eip-gateways
22852024-12-07T00:56:46.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44399 req_id = 8f40b4dd-e89b-4eff-832a-03b7479cab01 response_code = 204 uri = /vpc-routes
22862024-12-07T00:56:46.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38351
22872024-12-07T00:56:46.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38351 req_id = 4a2056c6-d210-48cc-bcea-87b875de02a3 response_code = 200 uri = /v2p
22882024-12-07T00:56:46.431ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41863
22892024-12-07T00:56:46.431ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22902024-12-07T00:56:46.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22912024-12-07T00:56:46.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41863 req_id = 94c253e9-e041-45a7-bb7d-90039a88dc70 response_code = 204 uri = /switch-ports
22922024-12-07T00:56:46.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41863 req_id = 200aed79-7701-4967-8537-773585edebfb response_code = 200 uri = /network-bootstore-config
22932024-12-07T00:56:46.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37474
22942024-12-07T00:56:46.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37474 req_id = b5a091a5-8b26-432d-baa7-8f9680a597d6 response_code = 200 uri = /vpc-routes
22952024-12-07T00:56:46.961ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
22962024-12-07T00:56:46.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37474 req_id = c936e0da-19f0-4539-9dbd-6c77dac9e58b response_code = 204 uri = /eip-gateways
22972024-12-07T00:56:46.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37474 req_id = f5365b46-ed7b-463b-9cd3-1a9ef5188462 response_code = 204 uri = /vpc-routes
22982024-12-07T00:56:47.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34789
22992024-12-07T00:56:47.047ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23002024-12-07T00:56:47.084ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23012024-12-07T00:56:47.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96974 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34789 req_id = 3868a6ac-29c5-41c2-9edc-42cad39c0145 response_code = 204 uri = /switch-ports
23022024-12-07T00:56:47.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50690
23032024-12-07T00:56:47.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50690 req_id = c02b685e-6998-427f-a0fa-4855c54d9e36 response_code = 200 uri = /v2p
23042024-12-07T00:56:47.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34789 req_id = 93278a93-25b1-4528-87fa-2850da25ad4f response_code = 200 uri = /network-bootstore-config
23052024-12-07T00:56:47.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51395
23062024-12-07T00:56:47.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51395 req_id = 8711ac22-aa48-4070-af09-fffff49af9e1 response_code = 200 uri = /vpc-routes
23072024-12-07T00:56:47.391ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23082024-12-07T00:56:47.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51395 req_id = c17670e3-7deb-4b8e-8879-fb9fe8837ca1 response_code = 204 uri = /eip-gateways
23092024-12-07T00:56:47.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55129
23102024-12-07T00:56:47.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55129 req_id = fdce834a-a665-4d99-a11e-bf5d3f3f2474 response_code = 200 uri = /v2p
23112024-12-07T00:56:47.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51395 req_id = b140f8cf-9e71-440f-9557-2faca9f58c0e response_code = 204 uri = /vpc-routes
23122024-12-07T00:56:47.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53868
23132024-12-07T00:56:47.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23142024-12-07T00:56:47.510ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23152024-12-07T00:56:47.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97429 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53868 req_id = c1b0babe-7598-47af-a015-ef771e03a207 response_code = 204 uri = /switch-ports
23162024-12-07T00:56:47.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53868 req_id = 2a29efc2-4d15-47ac-880f-363d498c9cc6 response_code = 200 uri = /network-bootstore-config
23172024-12-07T00:56:56.726ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57796
23182024-12-07T00:56:56.726ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57796 req_id = f7ee252a-64a4-4982-89e2-3da07a6c32e5 response_code = 200 uri = /baseboard
23192024-12-07T00:56:57.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7659 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 7d7f3ef5-4e7c-4f13-aa83-34dfc40eabd6 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
23202024-12-07T00:57:16.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54020
23212024-12-07T00:57:16.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54020 req_id = c7c796b1-6778-423a-b001-38c03c7574b5 response_code = 200 uri = /vpc-routes
23222024-12-07T00:57:16.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52666
23232024-12-07T00:57:16.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52666 req_id = e9038a19-1839-4ee5-9b64-797e8d6d3235 response_code = 200 uri = /v2p
23242024-12-07T00:57:16.585ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23252024-12-07T00:57:16.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54020 req_id = c0590616-4feb-4a98-8214-5a93b28109ca response_code = 204 uri = /eip-gateways
23262024-12-07T00:57:16.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54020 req_id = 08e27590-eb38-47f2-82ab-9ec6bc39c471 response_code = 204 uri = /vpc-routes
23272024-12-07T00:57:16.698ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55863
23282024-12-07T00:57:16.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23292024-12-07T00:57:16.737ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23302024-12-07T00:57:16.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55863 req_id = 705bf23b-4894-4b74-8946-33ef2cfad71a response_code = 204 uri = /switch-ports
23312024-12-07T00:57:16.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55863 req_id = 1c9cc7f1-bbcf-479c-944b-f8afa1f2085c response_code = 200 uri = /network-bootstore-config
23322024-12-07T00:57:17.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61588
23332024-12-07T00:57:17.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61588 req_id = 37f5c65c-82cf-4b36-92b9-a3d383095a7b response_code = 200 uri = /vpc-routes
23342024-12-07T00:57:17.169ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23352024-12-07T00:57:17.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61588 req_id = ed39455a-096f-4323-8eee-82b026650a28 response_code = 204 uri = /eip-gateways
23362024-12-07T00:57:17.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61588 req_id = 750b3252-cf9b-45a2-b492-0d005e3a6a46 response_code = 204 uri = /vpc-routes
23372024-12-07T00:57:17.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48732
23382024-12-07T00:57:17.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48732 req_id = 22d7f8fa-aa15-4a1a-8fd5-bf62de555a7b response_code = 200 uri = /v2p
23392024-12-07T00:57:17.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37931
23402024-12-07T00:57:17.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37931 req_id = 52c02229-d623-4458-81a8-42d84292a797 response_code = 200 uri = /vpc-routes
23412024-12-07T00:57:17.416ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23422024-12-07T00:57:17.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37931 req_id = 57227a48-341d-465b-948d-a69e43042c55 response_code = 204 uri = /eip-gateways
23432024-12-07T00:57:17.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53135
23442024-12-07T00:57:17.422ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23452024-12-07T00:57:17.468ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23462024-12-07T00:57:17.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53135 req_id = 038c63eb-32ca-4c5b-a0d3-633426e792b0 response_code = 204 uri = /switch-ports
23472024-12-07T00:57:17.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37931 req_id = c638aec7-492b-4edc-ac1b-55efa51d1a81 response_code = 204 uri = /vpc-routes
23482024-12-07T00:57:17.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53135 req_id = 7600bf95-f5dd-4b30-8607-c4fc195cf508 response_code = 200 uri = /network-bootstore-config
23492024-12-07T00:57:17.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40801
23502024-12-07T00:57:17.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40801 req_id = ef41cbf7-4b93-46d9-8c40-cda111bd76bf response_code = 200 uri = /v2p
23512024-12-07T00:57:17.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33699
23522024-12-07T00:57:17.674ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-12-07T00:57:17.710ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-12-07T00:57:17.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92172 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33699 req_id = 6f397982-b99f-4e69-ad7e-310ed92c6f03 response_code = 204 uri = /switch-ports
23552024-12-07T00:57:17.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33699 req_id = 5cfb615f-810c-4325-8a85-73fb04af4e0c response_code = 200 uri = /network-bootstore-config
23562024-12-07T00:57:26.759ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58761
23572024-12-07T00:57:26.759ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58761 req_id = 70e36842-5142-4250-933e-cc5288145f66 response_code = 200 uri = /baseboard
23582024-12-07T00:57:27.194ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6747 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = ab95d3ec-c97b-406f-b696-96fff449fe3c response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
23592024-12-07T00:57:46.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56512
23602024-12-07T00:57:46.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56512 req_id = e7a9fbcc-dedc-4bcd-85f8-10a0b41e7c9c response_code = 200 uri = /vpc-routes
23612024-12-07T00:57:46.421ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23622024-12-07T00:57:46.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56512 req_id = 0677a0c4-4ab5-4506-a00a-44859f3231a8 response_code = 204 uri = /eip-gateways
23632024-12-07T00:57:46.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56512 req_id = 9d5993e7-4805-4bfb-9a91-8410e210e39b response_code = 204 uri = /vpc-routes
23642024-12-07T00:57:46.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47580
23652024-12-07T00:57:46.487ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23662024-12-07T00:57:46.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23672024-12-07T00:57:46.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47580 req_id = d1605b3b-a2e3-4a55-9356-95fee30ce5bd response_code = 204 uri = /switch-ports
23682024-12-07T00:57:46.578ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56600
23692024-12-07T00:57:46.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56600 req_id = 676aeaed-02d3-4293-8e62-47916122a2c5 response_code = 200 uri = /v2p
23702024-12-07T00:57:46.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47580 req_id = 002ac9f4-8a37-43ad-b0eb-8a6e7b461700 response_code = 200 uri = /network-bootstore-config
23712024-12-07T00:57:47.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63545
23722024-12-07T00:57:47.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63545 req_id = 8d9db4f1-71ae-4e80-8e23-73f6c0a8618b response_code = 200 uri = /vpc-routes
23732024-12-07T00:57:47.071ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23742024-12-07T00:57:47.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63545 req_id = 3ee90b96-e3fb-4e1a-a769-f13b09d62df2 response_code = 204 uri = /eip-gateways
23752024-12-07T00:57:47.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63545 req_id = 28747254-06f4-49ed-b07f-5315b599e0c0 response_code = 204 uri = /vpc-routes
23762024-12-07T00:57:47.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57140
23772024-12-07T00:57:47.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57140 req_id = bd5bc157-ccfc-4452-8ea9-4bb52e55467a response_code = 200 uri = /v2p
23782024-12-07T00:57:47.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48798
23792024-12-07T00:57:47.231ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23802024-12-07T00:57:47.277ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23812024-12-07T00:57:47.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48798 req_id = fabc6769-be99-4277-9c5a-f5f7d551fd99 response_code = 204 uri = /switch-ports
23822024-12-07T00:57:47.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48798 req_id = ffcb8b8a-1aaa-4074-b8a9-b2f0a3462ec1 response_code = 200 uri = /network-bootstore-config
23832024-12-07T00:57:47.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57659
23842024-12-07T00:57:47.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57659 req_id = 96330722-ee98-49e7-8c58-91f141a5a59f response_code = 200 uri = /v2p
23852024-12-07T00:57:47.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47059
23862024-12-07T00:57:47.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47059 req_id = 0432831b-ed63-409f-a1d0-ec9b6152c3f4 response_code = 200 uri = /vpc-routes
23872024-12-07T00:57:47.473ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
23882024-12-07T00:57:47.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47059 req_id = cfb6d824-d538-4eb2-bce7-dfee271d3a22 response_code = 204 uri = /eip-gateways
23892024-12-07T00:57:47.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47059 req_id = f6fe0a9e-d2fa-4b04-be3e-914fa5e2b6f3 response_code = 204 uri = /vpc-routes
23902024-12-07T00:57:47.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44832
23912024-12-07T00:57:47.488ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23922024-12-07T00:57:47.523ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23932024-12-07T00:57:47.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44832 req_id = 1b3c4512-3615-4f97-83c5-b9c143614a01 response_code = 204 uri = /switch-ports
23942024-12-07T00:57:47.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44832 req_id = 68e4b508-7663-4a27-b514-7a0d3428c51a response_code = 200 uri = /network-bootstore-config
23952024-12-07T00:57:56.792ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47448
23962024-12-07T00:57:56.793ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47448 req_id = 43c54e1d-2390-4669-9039-b416a5c5d2a0 response_code = 200 uri = /baseboard
23972024-12-07T00:57:57.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7855 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 5dfe0d6b-f443-428f-97e1-16a54059a1db response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
23982024-12-07T00:58:16.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51741
23992024-12-07T00:58:16.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51741 req_id = f55043a9-3c78-4357-a399-cb1d3b4d8a16 response_code = 200 uri = /vpc-routes
24002024-12-07T00:58:16.460ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
24012024-12-07T00:58:16.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51741 req_id = 5a2daa1e-b61c-4513-bc8b-e2373261cae6 response_code = 204 uri = /eip-gateways
24022024-12-07T00:58:16.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51741 req_id = 5def3b35-012f-4be0-81e6-f54d349e0b8e response_code = 204 uri = /vpc-routes
24032024-12-07T00:58:16.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41840
24042024-12-07T00:58:16.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41840 req_id = 2eadb9bb-6833-4cdf-b318-fb942963e37b response_code = 200 uri = /v2p
24052024-12-07T00:58:16.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36089
24062024-12-07T00:58:16.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24072024-12-07T00:58:16.601ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24082024-12-07T00:58:16.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36089 req_id = 15c81ae9-b2bd-4a95-9fee-e8168721cf45 response_code = 204 uri = /switch-ports
24092024-12-07T00:58:16.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61648
24102024-12-07T00:58:16.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24112024-12-07T00:58:16.656ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24122024-12-07T00:58:16.656ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
24132024-12-07T00:58:16.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36089 req_id = 4d965757-5c0e-40e7-9601-ba63f02b1b77 response_code = 200 uri = /network-bootstore-config
24142024-12-07T00:58:16.658ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
24152024-12-07T00:58:16.671ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24162024-12-07T00:58:16.671ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f
24172024-12-07T00:58:16.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24182024-12-07T00:58:16.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8
24192024-12-07T00:58:16.718ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24202024-12-07T00:58:16.718ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37290789-dec6-48b1-bd11-48c109977543
24212024-12-07T00:58:16.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55334
24222024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24232024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24242024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24252024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24262024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24272024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24282024-12-07T00:58:16.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24292024-12-07T00:58:16.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 454 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55334 req_id = 4fc60344-629f-4acb-b1ca-4fea5865cc1d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24302024-12-07T00:58:16.740ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24312024-12-07T00:58:16.740ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b
24322024-12-07T00:58:16.759ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24332024-12-07T00:58:16.759ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14
24342024-12-07T00:58:16.786ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24352024-12-07T00:58:16.787ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c
24362024-12-07T00:58:16.824ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24372024-12-07T00:58:16.824ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c
24382024-12-07T00:58:16.868ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24392024-12-07T00:58:16.868ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7
24402024-12-07T00:58:16.899ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24412024-12-07T00:58:16.899ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9d33808d-deca-4533-adee-690176030136
24422024-12-07T00:58:16.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255967 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61648 req_id = 6b014c65-ac4f-453f-93f3-67ac041f55ca response_code = 200 uri = /inventory
24432024-12-07T00:58:17.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53339
24442024-12-07T00:58:17.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53339 req_id = 19628111-96df-4d8d-b608-60ffb1130906 response_code = 200 uri = /vpc-routes
24452024-12-07T00:58:17.138ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
24462024-12-07T00:58:17.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53339 req_id = bc100ede-356b-4b14-858a-950230b63dfd response_code = 204 uri = /eip-gateways
24472024-12-07T00:58:17.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 367 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53339 req_id = e80b247e-be26-45f0-b80f-39ad6599bf9e response_code = 204 uri = /vpc-routes
24482024-12-07T00:58:17.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42009
24492024-12-07T00:58:17.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42009 req_id = 95eef9cb-7a97-4712-9902-48f8abe2d7c7 response_code = 200 uri = /v2p
24502024-12-07T00:58:17.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44036
24512024-12-07T00:58:17.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24522024-12-07T00:58:17.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24532024-12-07T00:58:17.415ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
24542024-12-07T00:58:17.416ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
24552024-12-07T00:58:17.430ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24562024-12-07T00:58:17.430ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f
24572024-12-07T00:58:17.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43783
24582024-12-07T00:58:17.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24592024-12-07T00:58:17.469ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24602024-12-07T00:58:17.469ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8
24612024-12-07T00:58:17.480ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24622024-12-07T00:58:17.497ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24632024-12-07T00:58:17.497ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37290789-dec6-48b1-bd11-48c109977543
24642024-12-07T00:58:17.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48491
24652024-12-07T00:58:17.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48491 req_id = 019e1403-e0e2-4252-9296-e7bc6b4ae33f response_code = 200 uri = /vpc-routes
24662024-12-07T00:58:17.533ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24672024-12-07T00:58:17.533ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b
24682024-12-07T00:58:17.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130264 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43783 req_id = 0999597d-f16e-4bf7-b6d3-4b0997b779bc response_code = 204 uri = /switch-ports
24692024-12-07T00:58:17.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43783 req_id = 866e5a27-b9df-41ba-872a-9f08578a6234 response_code = 200 uri = /network-bootstore-config
24702024-12-07T00:58:17.571ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
24712024-12-07T00:58:17.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48491 req_id = bc9a1a06-959c-476b-8849-75d52d508d26 response_code = 204 uri = /eip-gateways
24722024-12-07T00:58:17.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24732024-12-07T00:58:17.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14
24742024-12-07T00:58:17.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 464 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48491 req_id = 4e5f3df5-0fc9-462a-9dde-651f4385e6c2 response_code = 204 uri = /vpc-routes
24752024-12-07T00:58:17.603ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24762024-12-07T00:58:17.603ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c
24772024-12-07T00:58:17.634ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24782024-12-07T00:58:17.634ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c
24792024-12-07T00:58:17.664ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24802024-12-07T00:58:17.664ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7
24812024-12-07T00:58:17.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38931
24822024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24832024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24842024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24852024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24862024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24872024-12-07T00:58:17.683ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24882024-12-07T00:58:17.684ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24892024-12-07T00:58:17.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 919 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38931 req_id = a69f8de9-d933-4903-bace-84cc584a3dd2 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24902024-12-07T00:58:17.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43380
24912024-12-07T00:58:17.685ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24922024-12-07T00:58:17.692ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
24932024-12-07T00:58:17.692ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9d33808d-deca-4533-adee-690176030136
24942024-12-07T00:58:17.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290532 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44036 req_id = 1886e8bc-7d7a-4d2f-961b-9ebaa851bd34 response_code = 200 uri = /inventory
24952024-12-07T00:58:17.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52185
24962024-12-07T00:58:17.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52185 req_id = cd86a531-54a4-45a8-8289-05ee38d5d0cf response_code = 200 uri = /v2p
24972024-12-07T00:58:17.727ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24982024-12-07T00:58:17.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43380 req_id = b5c06744-89db-417e-90b1-2213f2108789 response_code = 204 uri = /switch-ports
24992024-12-07T00:58:17.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43380 req_id = 620c1418-7462-4071-94e7-95ff4f876baa response_code = 200 uri = /network-bootstore-config
25002024-12-07T00:58:17.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38531
25012024-12-07T00:58:17.807ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25022024-12-07T00:58:17.807ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25032024-12-07T00:58:17.807ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/config/omicron-zones.json file = common/src/ledger.rs:177
25042024-12-07T00:58:17.808ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e4c25222-749e-4d77-939a-4c6435801dea/config/omicron-zones.json file = common/src/ledger.rs:177
25052024-12-07T00:58:17.819ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9580628c-320f-4dcc-9cd3-e10b9a45262f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25062024-12-07T00:58:17.819ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9580628c-320f-4dcc-9cd3-e10b9a45262f
25072024-12-07T00:58:17.844ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25082024-12-07T00:58:17.844ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8
25092024-12-07T00:58:17.867ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 37290789-dec6-48b1-bd11-48c109977543 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25102024-12-07T00:58:17.867ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_37290789-dec6-48b1-bd11-48c109977543
25112024-12-07T00:58:17.891ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d7b7168d-ac3c-4d62-9027-12da6a9e980b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25122024-12-07T00:58:17.891ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_d7b7168d-ac3c-4d62-9027-12da6a9e980b
25132024-12-07T00:58:17.915ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bba1b5aa-526a-4e09-80cf-68d83b926f14 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25142024-12-07T00:58:17.915ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bba1b5aa-526a-4e09-80cf-68d83b926f14
25152024-12-07T00:58:17.937ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 26f2723f-f521-47b7-b807-1d35d0e4be5c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25162024-12-07T00:58:17.937ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_26f2723f-f521-47b7-b807-1d35d0e4be5c
25172024-12-07T00:58:17.958ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 39e3bcab-7f38-4a60-beb3-2c51df32f92c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25182024-12-07T00:58:17.958ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_39e3bcab-7f38-4a60-beb3-2c51df32f92c
25192024-12-07T00:58:17.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45424
25202024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b1217bc9-c828-485f-b723-13405f5f0449, kind: Service { id: eda26d3e-18ec-4c21-8ff4-73abfd373bec }, name: Name("external-dns-eda26d3e-18ec-4c21-8ff4-73abfd373bec"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 161, 140])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e3a0fc5b-3469-4bf4-b890-223860d17bb2, kind: Service { id: fe4d45f4-708c-423b-9b9c-06a074a360b5 }, name: Name("external-dns-fe4d45f4-708c-423b-9b9c-06a074a360b5"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 109])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1734490d-a1a4-419c-8b88-60808ecac1e4, kind: Service { id: 00ea6ad0-de1a-4101-a100-38e35668045b }, name: Name("nexus-00ea6ad0-de1a-4101-a100-38e35668045b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 35])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6f41107d-92ca-434c-885d-e9e88da5ae74, kind: Service { id: 046d7edc-b85d-4313-a8cb-1398fbeee633 }, name: Name("nexus-046d7edc-b85d-4313-a8cb-1398fbeee633"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 184, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a2ebf7c3-f4be-46aa-981e-194de63d27ec, kind: Service { id: f962ecee-32c8-4ce5-b495-b2a9e4cf161a }, name: Name("nexus-f962ecee-32c8-4ce5-b495-b2a9e4cf161a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 217])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25212024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25222024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25232024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25242024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25252024-12-07T00:58:17.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25262024-12-07T00:58:17.973ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25272024-12-07T00:58:17.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 718 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45424 req_id = 4c1e290f-98f3-46fc-9849-8b359650ecf4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25282024-12-07T00:58:17.977ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 35ef0cce-8b13-4f11-ab35-845f875c58b7 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25292024-12-07T00:58:17.978ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_35ef0cce-8b13-4f11-ab35-845f875c58b7
25302024-12-07T00:58:17.998ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9d33808d-deca-4533-adee-690176030136 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
25312024-12-07T00:58:17.998ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9d33808d-deca-4533-adee-690176030136
25322024-12-07T00:58:18.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38531 req_id = 44d39ae9-d708-4842-9178-886d5248e81a response_code = 200 uri = /inventory
25332024-12-07T00:58:26.827ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47261
25342024-12-07T00:58:26.827ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47261 req_id = a3badeec-42f4-44e2-8f31-61c81e61e5d9 response_code = 200 uri = /baseboard
25352024-12-07T00:58:27.196ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8199 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 3d7df4ba-74c6-46e5-a2f9-71979afa2e04 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
25362024-12-07T00:58:46.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44248
25372024-12-07T00:58:46.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44248 req_id = 6278887e-aae8-4b92-bbbc-4e8aecc9fedd response_code = 200 uri = /vpc-routes
25382024-12-07T00:58:46.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25392024-12-07T00:58:46.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44248 req_id = 6e83c635-528d-4878-9a5a-d0420391e7fe response_code = 204 uri = /eip-gateways
25402024-12-07T00:58:46.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51286
25412024-12-07T00:58:46.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51286 req_id = 0a7da6d2-ab80-4f90-aad9-e43cd9078039 response_code = 200 uri = /v2p
25422024-12-07T00:58:46.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44248 req_id = e2545080-5d9f-41da-9173-0a28f7ed2c0a response_code = 204 uri = /vpc-routes
25432024-12-07T00:58:46.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53888
25442024-12-07T00:58:46.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25452024-12-07T00:58:46.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25462024-12-07T00:58:46.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53888 req_id = 1d8e021d-3fc1-4d64-a8a3-3e58059e424e response_code = 204 uri = /switch-ports
25472024-12-07T00:58:46.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53888 req_id = 1f57ce1e-be5e-487a-862f-192e0ac56413 response_code = 200 uri = /network-bootstore-config
25482024-12-07T00:58:46.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33435
25492024-12-07T00:58:46.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33435 req_id = 59e85247-453f-436c-a270-cbb64b2b1326 response_code = 200 uri = /vpc-routes
25502024-12-07T00:58:46.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25512024-12-07T00:58:46.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33435 req_id = 0ed1a0d7-865e-410d-b404-37ad4142cbcc response_code = 204 uri = /eip-gateways
25522024-12-07T00:58:46.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 365 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33435 req_id = ccd80f8f-b3bc-46d5-82ae-85b5170ccc7e response_code = 204 uri = /vpc-routes
25532024-12-07T00:58:47.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52028
25542024-12-07T00:58:47.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52028 req_id = 4620ee47-41c0-4ec0-bc9a-c0999711f0c8 response_code = 200 uri = /v2p
25552024-12-07T00:58:47.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35203
25562024-12-07T00:58:47.111ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25572024-12-07T00:58:47.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25582024-12-07T00:58:47.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35203 req_id = c61db5a4-9068-4ce9-89f9-4138f0f61c16 response_code = 204 uri = /switch-ports
25592024-12-07T00:58:47.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35203 req_id = e9e1c5d7-08ac-46b9-9856-d6462dab4312 response_code = 200 uri = /network-bootstore-config
25602024-12-07T00:58:47.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34601
25612024-12-07T00:58:47.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34601 req_id = 73e2c555-5d2e-40dd-bcc0-f230ae0f006a response_code = 200 uri = /vpc-routes
25622024-12-07T00:58:47.379ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25632024-12-07T00:58:47.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34601 req_id = 82a7f2a6-406f-4591-9599-d82e437dfdca response_code = 204 uri = /eip-gateways
25642024-12-07T00:58:47.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34601 req_id = 7ef3cbc3-bf75-42f1-b62e-cb5b156b09ab response_code = 204 uri = /vpc-routes
25652024-12-07T00:58:47.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38085
25662024-12-07T00:58:47.427ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25672024-12-07T00:58:47.464ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25682024-12-07T00:58:47.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38085 req_id = 8c364953-eee0-49c4-804f-c8a1311ee7c9 response_code = 204 uri = /switch-ports
25692024-12-07T00:58:47.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35084
25702024-12-07T00:58:47.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38085 req_id = b836f173-49f6-4958-99f2-b4c441ec52d0 response_code = 200 uri = /network-bootstore-config
25712024-12-07T00:58:47.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35084 req_id = 1ca888bc-2137-4aa6-a639-0191fafd5fde response_code = 200 uri = /v2p
25722024-12-07T00:58:56.861ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38276
25732024-12-07T00:58:56.861ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38276 req_id = 455ca1ec-bede-4d76-8a87-262ea27a1b3e response_code = 200 uri = /baseboard
25742024-12-07T00:58:57.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7754 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = d5d87a41-2157-4a7e-b1ee-49c2b20f9f7b response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
25752024-12-07T00:59:16.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59992
25762024-12-07T00:59:16.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59992 req_id = 38e23121-4f81-4f76-ae06-33b3ebd68b67 response_code = 200 uri = /vpc-routes
25772024-12-07T00:59:16.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25782024-12-07T00:59:16.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59992 req_id = 0644d479-ea76-4f73-bf76-c4d197d3437a response_code = 204 uri = /eip-gateways
25792024-12-07T00:59:16.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59992 req_id = 5462f62b-b02d-4382-8d8a-e4ffdd7d677b response_code = 204 uri = /vpc-routes
25802024-12-07T00:59:16.591ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62156
25812024-12-07T00:59:16.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62156 req_id = d402a200-ad2f-4101-9312-394874cc3b12 response_code = 200 uri = /v2p
25822024-12-07T00:59:16.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36512
25832024-12-07T00:59:16.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25842024-12-07T00:59:16.718ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25852024-12-07T00:59:16.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123785 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 6f96f51c-6903-43f3-8ba7-3eb6ca8a8013 response_code = 204 uri = /switch-ports
25862024-12-07T00:59:16.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36512 req_id = 09356d23-260d-4367-9d65-5e356d2e72c4 response_code = 200 uri = /network-bootstore-config
25872024-12-07T00:59:17.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58513
25882024-12-07T00:59:17.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58513 req_id = 9e817ea5-23f3-447c-8edc-ea121c3b40d2 response_code = 200 uri = /vpc-routes
25892024-12-07T00:59:17.193ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25902024-12-07T00:59:17.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58513 req_id = 0b6eab85-8957-4d37-97cf-d83fd851f46d response_code = 204 uri = /eip-gateways
25912024-12-07T00:59:17.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62406
25922024-12-07T00:59:17.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62406 req_id = d57a8578-ab41-4373-beac-6e2934fabf58 response_code = 200 uri = /v2p
25932024-12-07T00:59:17.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58513 req_id = faf04fb2-bd07-4baf-92e7-eb583ac5dcef response_code = 204 uri = /vpc-routes
25942024-12-07T00:59:17.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58569
25952024-12-07T00:59:17.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58569 req_id = c9385341-4739-4e0e-acd5-e019127dc633 response_code = 200 uri = /vpc-routes
25962024-12-07T00:59:17.410ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
25972024-12-07T00:59:17.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58569 req_id = 8c72c790-a0c8-47bb-88a0-48649276ea9d response_code = 204 uri = /eip-gateways
25982024-12-07T00:59:17.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37689
25992024-12-07T00:59:17.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26002024-12-07T00:59:17.458ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26012024-12-07T00:59:17.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37689 req_id = 01b334e9-8c58-43b2-a77d-ed2ebd5baf3b response_code = 204 uri = /switch-ports
26022024-12-07T00:59:17.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37689 req_id = 2e39c54e-cae9-4862-a109-1a0e93b29c5f response_code = 200 uri = /network-bootstore-config
26032024-12-07T00:59:17.550ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51999
26042024-12-07T00:59:17.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51999 req_id = de90d4f6-24d0-45c0-bc7d-c621af7fe8c9 response_code = 200 uri = /v2p
26052024-12-07T00:59:17.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58569 req_id = 32239909-dcbb-43e6-ba6d-ab3ab078e9ab response_code = 204 uri = /vpc-routes
26062024-12-07T00:59:17.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32859
26072024-12-07T00:59:17.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26082024-12-07T00:59:17.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26092024-12-07T00:59:17.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32859 req_id = e8fd6ffa-20d7-4b9d-9380-40448aa5a188 response_code = 204 uri = /switch-ports
26102024-12-07T00:59:17.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32859 req_id = ba2ef321-25ca-4e3a-acac-b87e4bb740ef response_code = 200 uri = /network-bootstore-config
26112024-12-07T00:59:26.893ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45158
26122024-12-07T00:59:26.894ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45158 req_id = d2cd732f-2dea-4d1f-80f6-1c1d4e6d5130 response_code = 200 uri = /baseboard
26132024-12-07T00:59:27.195ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7614 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = e4669cc6-405d-4105-925b-fc77555aad15 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
26142024-12-07T00:59:35.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59118
26152024-12-07T00:59:35.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59118 req_id = a180096b-b22e-4e1e-820c-08be08bfac77 response_code = 200 uri = /v2p
26162024-12-07T00:59:35.321ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1098235) }
26172024-12-07T00:59:35.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 975 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59118 req_id = 499a28bf-34f0-473f-b9fc-ecd52e011e11 response_code = 204 uri = /v2p
26182024-12-07T00:59:35.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47921
26192024-12-07T00:59:35.423ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1098235))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ea50e9a0169", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: eac94d6b-8176-41fd-8617-455c5f662336, read_only_parent: Some(Volume { block_size: 512, id: 96ff2727-64e1-434e-bf6b-e04e6f1bad43, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e8eaf72b-0976-43a2-b5cf-87e28a9cab2a, key: Some("Q74YLLob/26FOjhNxTQGBZEG5ozGz0oMZqKuKVsCwj8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: eac94d6b-8176-41fd-8617-455c5f662336, key: Some("z4IZSecSwiSRoAxrlIXKs02IidHIlEHV5BE3seBue0c="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::12]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-ea50e9a0169" }] }), cloud_init_bytes: Some(..) } instance_id = d4e357bc-806f-4b64-837e-f3433fef287e metadata = InstanceMetadata { silo_id: 3a67a720-d4af-42e7-875a-3abed4955db5, project_id: 5f29c645-1da0-4c9a-9e97-85eb8bea9c4c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-07T00:59:35.410121988Z }
26202024-12-07T00:59:35.423ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e migration_id = None propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26212024-12-07T00:59:35.423ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e migration_id = None propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1098235))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ad42495b-040b-4b67-a0fa-9d16ddaed7a9, kind: Instance { id: d4e357bc-806f-4b64-837e-f3433fef287e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1098235), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-ea50e9a0169", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: eac94d6b-8176-41fd-8617-455c5f662336, read_only_parent: Some(Volume { block_size: 512, id: 96ff2727-64e1-434e-bf6b-e04e6f1bad43, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e8eaf72b-0976-43a2-b5cf-87e28a9cab2a, key: Some("Q74YLLob/26FOjhNxTQGBZEG5ozGz0oMZqKuKVsCwj8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::12]:19001", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: eac94d6b-8176-41fd-8617-455c5f662336, key: Some("z4IZSecSwiSRoAxrlIXKs02IidHIlEHV5BE3seBue0c="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::19]:19000", "[fd00:1122:3344:101::12]:19002"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-ea50e9a0169" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-07T00:59:35.410121988Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26222024-12-07T00:59:35.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15892 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47921 req_id = f19283fe-9e33-4f1e-8582-fdfa64b398a7 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221
26232024-12-07T00:59:35.504ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35173
26242024-12-07T00:59:35.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 855 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35173 req_id = a9169f5d-4ea7-4fe5-a302-138c79f05b7f response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
26252024-12-07T00:59:35.510ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1098235 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26262024-12-07T00:59:35.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26272024-12-07T00:59:35.548ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221 file = illumos-utils/src/zone.rs:325 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26282024-12-07T00:59:35.572ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221 file = illumos-utils/src/zone.rs:363 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26292024-12-07T00:59:35.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51909
26302024-12-07T00:59:35.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51909 req_id = 41717bb1-ba38-42c2-99c9-a2596b8df967 response_code = 200 uri = /vpc-routes
26312024-12-07T00:59:35.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
26322024-12-07T00:59:37.097ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26332024-12-07T00:59:37.097ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221 zone file = illumos-utils/src/running_zone.rs:488 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26342024-12-07T00:59:37.270ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 68.501592ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26352024-12-07T00:59:37.369ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 59.937697ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26362024-12-07T00:59:37.443ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 154.178707ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26372024-12-07T00:59:37.610ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 431.266373ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26382024-12-07T00:59:38.054ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 759.175469ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26392024-12-07T00:59:38.824ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 752.199323ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26402024-12-07T00:59:39.587ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 1.180388056s file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26412024-12-07T00:59:40.778ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 1.312352019s file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 zone = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
26422024-12-07T00:59:42.120ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221 file = sled-agent/src/instance.rs:1786 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26432024-12-07T00:59:42.128ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 42.963898ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26442024-12-07T00:59:42.182ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 69.750566ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26452024-12-07T00:59:42.263ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 179.600456ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26462024-12-07T00:59:42.454ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 369.599768ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26472024-12-07T00:59:42.834ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221") failed: Property not found. retry in 782.224803ms file = illumos-utils/src/svc.rs:36 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26482024-12-07T00:59:43.627ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26492024-12-07T00:59:43.664ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26502024-12-07T00:59:43.805ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26512024-12-07T00:59:43.807ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-07T00:59:43.807569064Z } file = sled-agent/src/instance.rs:780 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26522024-12-07T00:59:43.807ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-07T00:59:43.807569064Z } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26532024-12-07T00:59:43.807ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-07T00:59:43.807569064Z }, migration_in: None, migration_out: None }
26542024-12-07T00:59:43.808ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
26552024-12-07T00:59:43.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8162022 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51909 req_id = 220fe7e3-ed47-4add-9bf8-f116626cad98 response_code = 204 uri = /eip-gateways
26562024-12-07T00:59:43.830ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-07T00:59:43.830514997Z } file = sled-agent/src/instance.rs:780 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26572024-12-07T00:59:43.830ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-07T00:59:43.830514997Z } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
26582024-12-07T00:59:43.830ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-07T00:59:43.830514997Z }, migration_in: None, migration_out: None }
26592024-12-07T00:59:43.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51909 req_id = 8d25f0c2-6b00-4be6-865d-86f418ada783 response_code = 204 uri = /vpc-routes
26602024-12-07T00:59:46.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59317
26612024-12-07T00:59:46.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59317 req_id = 9dc69578-f753-4d48-9060-7157b335a164 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
26622024-12-07T00:59:46.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33402
26632024-12-07T00:59:46.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33402 req_id = e1214f7f-6b15-4b75-ac33-935c948a0638 response_code = 200 uri = /vpc-routes
26642024-12-07T00:59:46.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
26652024-12-07T00:59:46.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33402 req_id = 81b16885-9b4a-4db7-b55e-5537fef4ed1c response_code = 204 uri = /eip-gateways
26662024-12-07T00:59:46.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33402 req_id = c58c2031-5bfa-46ba-906e-df7072a08cd7 response_code = 204 uri = /vpc-routes
26672024-12-07T00:59:46.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48999
26682024-12-07T00:59:46.490ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48999 req_id = 0042455a-c43e-4ed2-87ec-e9f90e1d78f3 response_code = 200 uri = /v2p
26692024-12-07T00:59:46.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39120
26702024-12-07T00:59:46.510ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26712024-12-07T00:59:46.549ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26722024-12-07T00:59:46.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39120 req_id = d35f1658-cf1a-4a03-8c1e-8eb9f856852f response_code = 204 uri = /switch-ports
26732024-12-07T00:59:46.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39120 req_id = e8a9e8ea-1a0d-4e81-a5ca-dfade9401384 response_code = 200 uri = /network-bootstore-config
26742024-12-07T00:59:46.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34084
26752024-12-07T00:59:46.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34084 req_id = 9aa7fbb8-490e-4c54-8da3-789637e995bc response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
26762024-12-07T00:59:46.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53042
26772024-12-07T00:59:46.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53042 req_id = 900955a7-5c82-4014-83e7-3c47f174d15b response_code = 200 uri = /vpc-routes
26782024-12-07T00:59:47.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
26792024-12-07T00:59:47.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53042 req_id = 571487e6-57ad-4c65-9c2c-f2edfa9383c6 response_code = 204 uri = /eip-gateways
26802024-12-07T00:59:47.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48214
26812024-12-07T00:59:47.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48214 req_id = 1ade90d6-4ee5-40d0-b22f-b4a2a14d423c response_code = 200 uri = /v2p
26822024-12-07T00:59:47.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53042 req_id = 5d89c8bf-051e-4411-be19-6acaea62c027 response_code = 204 uri = /vpc-routes
26832024-12-07T00:59:47.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54472
26842024-12-07T00:59:47.152ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26852024-12-07T00:59:47.202ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26862024-12-07T00:59:47.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114912 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54472 req_id = 76dd7f4a-1bcd-4c2e-9e60-2e5c05e449f1 response_code = 204 uri = /switch-ports
26872024-12-07T00:59:47.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54472 req_id = a3c86893-af94-4dd0-9b2f-8df79d6ce22c response_code = 200 uri = /network-bootstore-config
26882024-12-07T00:59:47.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59473
26892024-12-07T00:59:47.366ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59473 req_id = 2134d346-417d-4841-9cd1-32300b07ee5d response_code = 200 uri = /vpc-routes
26902024-12-07T00:59:47.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49716
26912024-12-07T00:59:47.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49716 req_id = 590c7dae-6afc-48df-9542-a8288f4ab091 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
26922024-12-07T00:59:47.415ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
26932024-12-07T00:59:47.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59473 req_id = 2de71b39-06c0-4c2f-826f-4440c5a26ed2 response_code = 204 uri = /eip-gateways
26942024-12-07T00:59:47.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59473 req_id = c27e764e-f2cb-4004-a8cd-2f2040701bae response_code = 204 uri = /vpc-routes
26952024-12-07T00:59:47.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51777
26962024-12-07T00:59:47.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26972024-12-07T00:59:47.516ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26982024-12-07T00:59:47.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51777 req_id = b17f0e22-eddc-4b99-af22-a75a9005270a response_code = 204 uri = /switch-ports
26992024-12-07T00:59:47.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43558
27002024-12-07T00:59:47.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43558 req_id = e6b727b7-fa82-442c-8ffc-1dac4b58e946 response_code = 200 uri = /v2p
27012024-12-07T00:59:47.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51777 req_id = db5b8e2a-6dee-4408-a920-8de21b0dbf7c response_code = 200 uri = /network-bootstore-config
27022024-12-07T00:59:56.926ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50904
27032024-12-07T00:59:56.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50904 req_id = 7dab815d-dc10-4612-9073-1bd508c26587 response_code = 200 uri = /baseboard
27042024-12-07T00:59:57.227ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7704 local_addr = [fd00:1122:3344:101::1]:51308 method = GET remote_addr = [fd00:1122:3344:101::d]:39781 req_id = 6fffdd32-ccb1-4ea9-a790-56427cb2e611 response_code = 200 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 uri = /e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
27052024-12-07T01:00:16.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60680
27062024-12-07T01:00:16.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60680 req_id = 46cfbb5e-c2ad-4b23-96df-d48f430c5bae response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
27072024-12-07T01:00:16.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52738
27082024-12-07T01:00:16.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52738 req_id = a15424d0-8981-44fa-8382-825e0ea5f71c response_code = 200 uri = /vpc-routes
27092024-12-07T01:00:16.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
27102024-12-07T01:00:16.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52738 req_id = 5e00f03d-9a64-4483-ac39-7acc9d4bee17 response_code = 204 uri = /eip-gateways
27112024-12-07T01:00:16.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50616
27122024-12-07T01:00:16.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50616 req_id = 51b2427f-ec61-4b9b-a541-6bd2ed0f0dd2 response_code = 200 uri = /v2p
27132024-12-07T01:00:16.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52738 req_id = 2feb849a-8f0d-4b17-9e31-e3f2195fbb84 response_code = 204 uri = /vpc-routes
27142024-12-07T01:00:16.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52681
27152024-12-07T01:00:16.761ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27162024-12-07T01:00:16.803ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27172024-12-07T01:00:16.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52681 req_id = 4f1c6f42-236e-4901-a1c7-82a56579ef8d response_code = 204 uri = /switch-ports
27182024-12-07T01:00:16.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52681 req_id = df37b6aa-8ce1-49cc-9f97-87fd099d5bcc response_code = 200 uri = /network-bootstore-config
27192024-12-07T01:00:17.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65525
27202024-12-07T01:00:17.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65525 req_id = a71e5732-4f70-41ec-9b70-49530be0b866 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
27212024-12-07T01:00:17.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63604
27222024-12-07T01:00:17.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 20f8536b-67ae-4d65-a1ad-68198bcae43d response_code = 200 uri = /vpc-routes
27232024-12-07T01:00:17.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
27242024-12-07T01:00:17.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 8c48a101-7f5c-46b0-8169-670e60f3c2e1 response_code = 204 uri = /eip-gateways
27252024-12-07T01:00:17.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 402 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63604 req_id = 1bb74ce7-2369-46f1-aba1-48c58f5943b1 response_code = 204 uri = /vpc-routes
27262024-12-07T01:00:17.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40555
27272024-12-07T01:00:17.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27282024-12-07T01:00:17.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27292024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40555 req_id = 31f2381e-56bd-447b-823f-287211a7ba9b response_code = 204 uri = /switch-ports
27302024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53869
27312024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40624
27322024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40624 req_id = 65fe7c75-ffbe-4080-9e2c-8e8c7e69ae97 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
27332024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40555 req_id = 115c76fb-5c7f-43e2-aef3-92ce29e1f69b response_code = 200 uri = /network-bootstore-config
27342024-12-07T01:00:17.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53869 req_id = afa9334d-55c6-44ff-a0c6-c16b8b656056 response_code = 200 uri = /v2p
27352024-12-07T01:00:17.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33442
27362024-12-07T01:00:17.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33442 req_id = 36b8c3c5-6057-4bd2-8189-89bbfba2c4f7 response_code = 200 uri = /vpc-routes
27372024-12-07T01:00:17.534ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
27382024-12-07T01:00:17.534ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33442 req_id = 6020b989-8fe3-4f98-9838-7b5ec7daf4af response_code = 204 uri = /eip-gateways
27392024-12-07T01:00:17.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33442 req_id = 897f7729-ecbe-40aa-b783-c949a3c316e3 response_code = 204 uri = /vpc-routes
27402024-12-07T01:00:17.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54918
27412024-12-07T01:00:17.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54918 req_id = fe0f2533-3fe5-41c4-a200-934bd8d069ab response_code = 200 uri = /v2p
27422024-12-07T01:00:17.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58524
27432024-12-07T01:00:17.698ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27442024-12-07T01:00:17.735ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27452024-12-07T01:00:17.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58524 req_id = 48903a8b-5064-47fd-a725-75121c1e00c4 response_code = 204 uri = /switch-ports
27462024-12-07T01:00:17.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58524 req_id = fa6697ea-0f58-4192-9074-c2589befa9c1 response_code = 200 uri = /network-bootstore-config
27472024-12-07T01:00:19.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58805
27482024-12-07T01:00:19.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58805 req_id = 83734b14-131f-49b7-a33a-6feffcc65ed3 response_code = 200 uri = /vmms/cdff06af-548d-4d6e-8e27-5f181e4ed221/state
27492024-12-07T01:00:19.166ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-07T01:00:19.166395898Z } file = sled-agent/src/instance.rs:780 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27502024-12-07T01:00:19.166ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-07T01:00:19.166395898Z } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27512024-12-07T01:00:19.166ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-07T01:00:19.166395898Z }, migration_in: None, migration_out: None }
27522024-12-07T01:00:19.202ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-07T01:00:19.202702454Z } file = sled-agent/src/instance.rs:780 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27532024-12-07T01:00:19.202ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-07T01:00:19.202702454Z } propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27542024-12-07T01:00:19.202ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27552024-12-07T01:00:19.202ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27562024-12-07T01:00:19.203ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 1039927164230163893 n_samples = 12 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
27572024-12-07T01:00:19.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27582024-12-07T01:00:19.203ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 16497581512636871254 n_samples = 12 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
27592024-12-07T01:00:19.204ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/e4c25222-749e-4d77-939a-4c6435801dea/debug/bundle/zone", "/pool/int/f4878337-f259-4e9a-8a59-7c0e80a9fc4d/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/9580628c-320f-4dcc-9cd3-e10b9a45262f/crypt/debug", "/pool/ext/c3b928c7-a4e5-4b3c-8d31-ac4b4924a4f8/crypt/debug", "/pool/ext/37290789-dec6-48b1-bd11-48c109977543/crypt/debug", "/pool/ext/d7b7168d-ac3c-4d62-9027-12da6a9e980b/crypt/debug", "/pool/ext/bba1b5aa-526a-4e09-80cf-68d83b926f14/crypt/debug", "/pool/ext/26f2723f-f521-47b7-b807-1d35d0e4be5c/crypt/debug", "/pool/ext/39e3bcab-7f38-4a60-beb3-2c51df32f92c/crypt/debug", "/pool/ext/35ef0cce-8b13-4f11-ab35-845f875c58b7/crypt/debug", "/pool/ext/9d33808d-deca-4533-adee-690176030136/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221
27602024-12-07T01:00:19.885ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221", bundle_id: 142d40ae-828e-4b41-b260-f635d34b438e }, time_created: 2024-12-07T01:00:19.205708394Z, version: 0, cause: TerminatedInstance }
27612024-12-07T01:00:19.885ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_cdff06af-548d-4d6e-8e27-5f181e4ed221 file = sled-agent/src/instance.rs:1032 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27622024-12-07T01:00:21.651ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27632024-12-07T01:00:21.667ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1098235), kind: System }
27642024-12-07T01:00:21.667ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1098235), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27652024-12-07T01:00:21.668ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-07T01:00:21.668024707Z }, migration_in: None, migration_out: None }
27662024-12-07T01:00:21.693ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-07T01:00:21.668024707Z }, migration_in: None, migration_out: None }
27672024-12-07T01:00:21.698ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = d4e357bc-806f-4b64-837e-f3433fef287e propolis_id = cdff06af-548d-4d6e-8e27-5f181e4ed221
27682024-12-07T01:00:22.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40601
27692024-12-07T01:00:22.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40601 req_id = 4ffa4739-bd55-4a13-a01b-620f52f24d1c response_code = 200 uri = /vpc-routes
27702024-12-07T01:00:22.190ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {ad42495b-040b-4b67-a0fa-9d16ddaed7a9: {10.151.2.176: {4f344fc7-2464-4c76-8b6a-425472f23c9f}, 10.151.2.175: {4f344fc7-2464-4c76-8b6a-425472f23c9f}}} }
27712024-12-07T01:00:22.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40601 req_id = e911e5d1-87d5-4eaf-aef2-0cea2d22ee46 response_code = 204 uri = /eip-gateways
27722024-12-07T01:00:22.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40601 req_id = 9f272839-cfe4-4015-936c-30e9950ea879 response_code = 204 uri = /vpc-routes
27732024-12-07T01:00:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54610
27742024-12-07T01:00:22.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54610 req_id = d4121618-4636-4e81-b0d4-aed8d5904764 response_code = 200 uri = /v2p
27752024-12-07T01:00:22.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50820
27762024-12-07T01:00:22.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50820 req_id = 7ddb591b-575d-47ea-bb46-43d1b9428921 response_code = 200 uri = /v2p
27772024-12-07T01:00:22.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49139
27782024-12-07T01:00:22.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49139 req_id = 47160368-f691-414c-a4e5-57103edefd04 response_code = 200 uri = /vpc-routes
27792024-12-07T01:00:22.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
27802024-12-07T01:00:22.634ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3
27812024-12-07T01:00:22.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49139 req_id = da49d08b-29a3-4c31-85b4-d0fc5e9c8113 response_code = 204 uri = /eip-gateways
27822024-12-07T01:00:22.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49139 req_id = 8a8aebd9-c2f0-49f5-847b-52bd6943ef98 response_code = 204 uri = /vpc-routes
27832024-12-07T01:00:23.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41118
27842024-12-07T01:00:23.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41118 req_id = 8e0c4c12-c345-430c-9cb2-b88b15396eed response_code = 200 uri = /vpc-routes
27852024-12-07T01:00:23.361ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = e6c44bf0-8a98-4b5e-823b-bbdeea63c1d3 values = ExternalIpGatewayMap { mappings: {} }
27862024-12-07T01:00:23.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41118 req_id = 034e73a2-4a22-4f6d-8bc5-c635d3385885 response_code = 204 uri = /eip-gateways
27872024-12-07T01:00:23.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41118 req_id = 99b4c66c-c70d-4725-8c35-25458ad6fcd2 response_code = 204 uri = /vpc-routes