Max level shown:
1 [ Dec 6 21:12:13 Enabled. ]
2 [ Dec 6 21:12:13 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Dec 6 21:12:13 Method "start" exited with status 0. ]
4 [ Dec 6 21:12:13 Rereading configuration. ]
5 [ Dec 6 21:12:13 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-12-06T21:12:13.709ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-12-06T21:12:13.709ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-12-06T21:12:13.763ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-12-06T21:12:13.763ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-12-06T21:12:13.878ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-12-06T21:12:13.886ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-12-06T21:12:13.895ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-12-06T21:12:14.496ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-12-06T21:12:14.637ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-12-06T21:12:14.637ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-12-06T21:12:14.637ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-12-06T21:12:14.638ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-12-06T21:12:14.638ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202024-12-06T21:12:14.638ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212024-12-06T21:12:14.641ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222024-12-06T21:12:14.641ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232024-12-06T21:12:14.641ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-12-06T21:12:14.641ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252024-12-06T21:12:14.641ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-12-06T21:12:14.641ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-12-06T21:12:14.641ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282024-12-06T21:12:14.641ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-12-06T21:12:14.641ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-12-06T21:12:14.653ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312024-12-06T21:12:14.653ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool)
322024-12-06T21:12:14.754ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal }
332024-12-06T21:12:15.228ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342024-12-06T21:12:15.228ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-12-06T21:12:15.228ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-12-06T21:12:15.228ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-12-06T21:12:15.228ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382024-12-06T21:12:15.228ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-12-06T21:12:15.228ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-12-06T21:12:15.237ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412024-12-06T21:12:15.237ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool)
422024-12-06T21:12:15.322ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal }
432024-12-06T21:12:15.789ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-12-06T21:12:15.789ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472024-12-06T21:12:15.789ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
482024-12-06T21:12:15.789ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-12-06T21:12:15.789ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-12-06T21:12:15.789ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-12-06T21:12:15.789ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
542024-12-06T21:12:15.789ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-12-06T21:12:15.789ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-12-06T21:12:15.789ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572024-12-06T21:12:15.789ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
582024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592024-12-06T21:12:15.789ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-12-06T21:12:15.789ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-12-06T21:12:15.789ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
632024-12-06T21:12:15.789ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642024-12-06T21:12:15.789ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662024-12-06T21:12:15.789ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672024-12-06T21:12:15.789ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
692024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
702024-12-06T21:12:15.790ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732024-12-06T21:12:15.790ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782024-12-06T21:12:15.790ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-12-06T21:12:15.790ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
842024-12-06T21:12:15.790ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-12-06T21:12:15.790ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872024-12-06T21:12:15.790ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892024-12-06T21:12:15.790ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
902024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
912024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
922024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932024-12-06T21:12:15.790ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-12-06T21:12:15.790ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
962024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982024-12-06T21:12:15.790ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-12-06T21:12:15.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002024-12-06T21:12:15.790ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-12-06T21:12:15.790ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-12-06T21:12:15.790ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-12-06T21:12:15.790ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-12-06T21:12:15.790ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-12-06T21:12:15.790ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-12-06T21:12:15.801ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132024-12-06T21:12:15.801ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1251, tv_nsec: 109897441 } time_to_next_cleanup = 599.999910729s
1142024-12-06T21:12:15.801ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152024-12-06T21:12:15.801ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162024-12-06T21:12:15.801ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-12-06T21:12:15.803ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-12-06T21:12:15.804ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-12-06T21:12:15.806ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-12-06T21:12:15.806ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212024-12-06T21:12:15.806ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222024-12-06T21:12:15.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232024-12-06T21:12:15.806ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242024-12-06T21:12:15.806ZINFOSledAgent (RSS): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/rss-started.marker file = common/src/ledger.rs:188
1252024-12-06T21:12:15.806ZINFOSledAgent (RSS): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/rss-started.marker file = common/src/ledger.rs:188
1262024-12-06T21:12:15.806ZINFOSledAgent (RSS): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272024-12-06T21:12:15.806ZINFOSledAgent (RSS): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282024-12-06T21:12:15.806ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292024-12-06T21:12:15.806ZINFOSledAgent (RSS): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302024-12-06T21:12:15.806ZINFOSledAgent (RSS): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312024-12-06T21:12:15.807ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322024-12-06T21:12:15.807ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332024-12-06T21:12:15.807ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342024-12-06T21:12:15.807ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352024-12-06T21:12:15.807ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362024-12-06T21:12:15.807ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372024-12-06T21:12:15.807ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382024-12-06T21:12:15.807ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392024-12-06T21:12:15.807ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: cbc5c1c6-5668-455a-85ef-94f4aebe0f80 (sled), rack_id: 2d75e4a3-6363-4fd1-935e-989d31fd7d71, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402024-12-06T21:12:15.807ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412024-12-06T21:12:15.807ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422024-12-06T21:12:15.812ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432024-12-06T21:12:15.817ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442024-12-06T21:12:15.817ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452024-12-06T21:12:15.822ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462024-12-06T21:12:15.822ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472024-12-06T21:12:15.824ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53112
1482024-12-06T21:12:15.825ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: cbc5c1c6-5668-455a-85ef-94f4aebe0f80 (sled), rack_id: 2d75e4a3-6363-4fd1-935e-989d31fd7d71, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492024-12-06T21:12:15.825ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502024-12-06T21:12:15.825ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512024-12-06T21:12:15.825ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552024-12-06T21:12:15.825ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602024-12-06T21:12:15.825ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612024-12-06T21:12:15.825ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622024-12-06T21:12:15.836ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632024-12-06T21:12:15.854ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642024-12-06T21:12:15.870ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652024-12-06T21:12:15.898ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1662024-12-06T21:12:15.898ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672024-12-06T21:12:15.898ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1682024-12-06T21:12:15.898ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692024-12-06T21:12:15.901ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 70.797196ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ed799d8c-b3c3-4bf2-b11d-517bdc13a702", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ed799d8c-b3c3-4bf2-b11d-517bdc13a702" } file = clients/ddm-admin-client/src/lib.rs:177
1702024-12-06T21:12:15.911ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_cee4e847-3bb9-425f-a5d6-c199bac4aab1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712024-12-06T21:12:15.936ZINFOSledAgent: successfully created encrypted zvol: name="oxi_cee4e847-3bb9-425f-a5d6-c199bac4aab1/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722024-12-06T21:12:15.936ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_cee4e847-3bb9-425f-a5d6-c199bac4aab1/swap" file = sled-agent/src/swap_device.rs:96
1732024-12-06T21:12:15.942ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1742024-12-06T21:12:15.942ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752024-12-06T21:12:15.942ZINFOSledAgent (BackingFs): Ensuring dataset oxi_cee4e847-3bb9-425f-a5d6-c199bac4aab1/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762024-12-06T21:12:15.973ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-12-06T21:12:15.974ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.886542ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a20817ac-1d3a-4108-805d-f8962090439c", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a20817ac-1d3a-4108-805d-f8962090439c" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-12-06T21:12:16.032ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792024-12-06T21:12:16.049ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802024-12-06T21:12:16.050ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 150.632584ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "20bb4cdd-0837-4d0c-bc8e-d2062a480010", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "20bb4cdd-0837-4d0c-bc8e-d2062a480010" } file = clients/ddm-admin-client/src/lib.rs:177
1812024-12-06T21:12:16.202ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1822024-12-06T21:12:16.202ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 204.319143ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cc9c75cf-1826-49d1-a630-183347d136fe", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cc9c75cf-1826-49d1-a630-183347d136fe" } file = clients/ddm-admin-client/src/lib.rs:177
1832024-12-06T21:12:16.255ZINFOSledAgent (BackingFs): Mounting oxi_cee4e847-3bb9-425f-a5d6-c199bac4aab1/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1842024-12-06T21:12:16.268ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1852024-12-06T21:12:16.268ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1862024-12-06T21:12:16.268ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1872024-12-06T21:12:16.268ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1882024-12-06T21:12:16.408ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892024-12-06T21:12:16.409ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 306.678202ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e8cbf1e6-7750-42c1-b108-e616a1a93b70", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e8cbf1e6-7750-42c1-b108-e616a1a93b70" } file = clients/ddm-admin-client/src/lib.rs:177
1902024-12-06T21:12:16.716ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912024-12-06T21:12:16.716ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 131.603642ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7e5bf111-4f5a-4b61-a6f3-4f1557772dbe", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7e5bf111-4f5a-4b61-a6f3-4f1557772dbe" } file = clients/ddm-admin-client/src/lib.rs:177
1922024-12-06T21:12:16.848ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932024-12-06T21:12:16.849ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 267.699688ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "844e654f-b242-490b-8187-07f332789c84", "content-length": "124", "date": "Fri, 06 Dec 2024 21:12:16 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "844e654f-b242-490b-8187-07f332789c84" } file = clients/ddm-admin-client/src/lib.rs:177
1942024-12-06T21:12:17.010ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1952024-12-06T21:12:17.016ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:48012 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1962024-12-06T21:12:17.016ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1972024-12-06T21:12:17.016ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48012 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1982024-12-06T21:12:17.017ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 131.480724ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
1992024-12-06T21:12:17.018ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2002024-12-06T21:12:17.018ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2012024-12-06T21:12:17.018ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022024-12-06T21:12:17.018ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032024-12-06T21:12:17.117ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042024-12-06T21:12:17.150ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 733.674753ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2052024-12-06T21:12:17.886ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.423678047s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2062024-12-06T21:12:19.312ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.426687176s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2072024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122024-12-06T21:12:19.571ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132024-12-06T21:12:19.573ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142024-12-06T21:12:19.574ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152024-12-06T21:12:19.574ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='91955a5d-cbe0-46b9-9d8b-863e29c25b6b'/> <propval type="astring" name="rack_id" value='2d75e4a3-6363-4fd1-935e-989d31fd7d71'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe28:8059'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='2d75e4a3-6363-4fd1-935e-989d31fd7d71'/> <propval type="astring" name="sled_id" value='cbc5c1c6-5668-455a-85ef-94f4aebe0f80'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='cbc5c1c6-5668-455a-85ef-94f4aebe0f80'/> <propval type="astring" name="rack_uuid" value='2d75e4a3-6363-4fd1-935e-989d31fd7d71'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='cbc5c1c6-5668-455a-85ef-94f4aebe0f80'/> <propval type="astring" name="rack_uuid" value='2d75e4a3-6363-4fd1-935e-989d31fd7d71'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162024-12-06T21:12:19.575ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172024-12-06T21:12:19.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 52.142317ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-12-06T21:12:20.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.536645ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-12-06T21:12:20.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 155.832602ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202024-12-06T21:12:20.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 556.409197ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-12-06T21:12:21.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 908.607769ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-12-06T21:12:21.740ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.286119469s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2232024-12-06T21:12:22.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.386780232s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-12-06T21:12:23.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.070013492s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252024-12-06T21:12:24.027ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.627616749s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2262024-12-06T21:12:24.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.462715212s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272024-12-06T21:12:26.588ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/nexus.rs:527 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2282024-12-06T21:12:26.617ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292024-12-06T21:12:26.618ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2302024-12-06T21:12:26.619ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312024-12-06T21:12:26.619ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322024-12-06T21:12:26.619ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332024-12-06T21:12:26.619ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342024-12-06T21:12:26.619ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352024-12-06T21:12:26.619ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362024-12-06T21:12:26.620ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372024-12-06T21:12:26.620ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382024-12-06T21:12:26.620ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:53112
2392024-12-06T21:12:26.819ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2402024-12-06T21:12:26.819ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2412024-12-06T21:12:26.824ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-12-06T21:12:26.824ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2432024-12-06T21:12:26.824ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-12-06T21:12:27.050ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2452024-12-06T21:12:27.051ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17817982598274688407 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2462024-12-06T21:12:27.051ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257920911906253608 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2472024-12-06T21:12:27.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55684
2482024-12-06T21:12:27.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2492024-12-06T21:12:27.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2502024-12-06T21:12:27.079ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:188
2512024-12-06T21:12:27.079ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:188
2522024-12-06T21:12:27.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55684 req_id = 2906e75a-74f1-4b62-8695-b819451176c6 response_code = 200 uri = /inventory
2532024-12-06T21:12:27.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55838
2542024-12-06T21:12:27.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55838 req_id = ccaef22e-244c-49f1-9f58-999d88042190 response_code = 200 uri = /sled-role
2552024-12-06T21:12:27.141ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 83b2377c-5170-4897-8604-77800240c324 (physical_disk), pool_id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ea4a8a1f-2370-4962-8d87-aa609bc3fc30 (physical_disk), pool_id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7a41c6bd-a741-457b-95bd-5eb8ee284caa (physical_disk), pool_id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 295e74a4-c5f5-4d48-b453-546b2d8c1339 (physical_disk), pool_id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f2155ccf-11c2-4672-9f07-b2845f2c2662 (physical_disk), pool_id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 054b0537-2c62-4f72-ae3a-5584ff368bd6 (physical_disk), pool_id: 56416138-2c59-4897-b953-6407738ebcfc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 58111a5a-c288-4725-af5d-24c559933523 (physical_disk), pool_id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 23741520-31c0-4bfd-9ee9-ed516368603d (physical_disk), pool_id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 15306c1b-8196-43e1-a082-25e8ef691ba7 (physical_disk), pool_id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2562024-12-06T21:12:27.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33751
2572024-12-06T21:12:27.141ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2582024-12-06T21:12:27.141ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 83b2377c-5170-4897-8604-77800240c324 (physical_disk), pool_id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: ea4a8a1f-2370-4962-8d87-aa609bc3fc30 (physical_disk), pool_id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7a41c6bd-a741-457b-95bd-5eb8ee284caa (physical_disk), pool_id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 295e74a4-c5f5-4d48-b453-546b2d8c1339 (physical_disk), pool_id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: f2155ccf-11c2-4672-9f07-b2845f2c2662 (physical_disk), pool_id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 054b0537-2c62-4f72-ae3a-5584ff368bd6 (physical_disk), pool_id: 56416138-2c59-4897-b953-6407738ebcfc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 58111a5a-c288-4725-af5d-24c559933523 (physical_disk), pool_id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 23741520-31c0-4bfd-9ee9-ed516368603d (physical_disk), pool_id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 15306c1b-8196-43e1-a082-25e8ef691ba7 (physical_disk), pool_id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2592024-12-06T21:12:27.141ZINFOSledAgent (StorageManager): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-12-06T21:12:27.141ZINFOSledAgent (StorageManager): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612024-12-06T21:12:27.141ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2622024-12-06T21:12:27.141ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2632024-12-06T21:12:27.141ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2642024-12-06T21:12:27.141ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2652024-12-06T21:12:27.141ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2662024-12-06T21:12:27.153ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2672024-12-06T21:12:27.153ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool)
2682024-12-06T21:12:27.249ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }
2692024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2702024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2712024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2722024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2732024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-12-06T21:12:27.257ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2762024-12-06T21:12:27.291ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2772024-12-06T21:12:27.299ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone file = sled-storage/src/dataset.rs:303
2782024-12-06T21:12:27.470ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d file = sled-storage/src/dataset.rs:389
2792024-12-06T21:12:27.480ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2802024-12-06T21:12:27.480ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2812024-12-06T21:12:27.480ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2822024-12-06T21:12:27.480ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2832024-12-06T21:12:27.480ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2842024-12-06T21:12:27.491ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2852024-12-06T21:12:27.491ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool)
2862024-12-06T21:12:27.585ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }
2872024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2882024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2892024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2902024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2912024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-12-06T21:12:27.594ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2942024-12-06T21:12:27.621ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
2952024-12-06T21:12:27.629ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-12-06T21:12:27.637ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone file = sled-storage/src/dataset.rs:303
2972024-12-06T21:12:27.810ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17 file = sled-storage/src/dataset.rs:389
2982024-12-06T21:12:27.818ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-12-06T21:12:27.818ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-12-06T21:12:27.818ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-12-06T21:12:27.818ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-12-06T21:12:27.818ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-12-06T21:12:27.828ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3042024-12-06T21:12:27.828ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool)
3052024-12-06T21:12:27.922ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }
3062024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3072024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3082024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3092024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3102024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-12-06T21:12:27.930ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3132024-12-06T21:12:27.965ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-12-06T21:12:27.973ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone file = sled-storage/src/dataset.rs:303
3152024-12-06T21:12:28.150ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 file = sled-storage/src/dataset.rs:389
3162024-12-06T21:12:28.157ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3172024-12-06T21:12:28.158ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3182024-12-06T21:12:28.158ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3192024-12-06T21:12:28.158ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3202024-12-06T21:12:28.158ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212024-12-06T21:12:28.168ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3222024-12-06T21:12:28.168ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = c5430cc8-489c-438a-b730-df567e7b3e13 (zpool)
3232024-12-06T21:12:28.264ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }
3242024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3252024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3262024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3272024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3282024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-12-06T21:12:28.273ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3312024-12-06T21:12:28.310ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-12-06T21:12:28.317ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone file = sled-storage/src/dataset.rs:303
3332024-12-06T21:12:28.490ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c5430cc8-489c-438a-b730-df567e7b3e13 file = sled-storage/src/dataset.rs:389
3342024-12-06T21:12:28.498ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3352024-12-06T21:12:28.498ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3362024-12-06T21:12:28.498ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3372024-12-06T21:12:28.498ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3382024-12-06T21:12:28.498ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-12-06T21:12:28.507ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3402024-12-06T21:12:28.507ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool)
3412024-12-06T21:12:28.596ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }
3422024-12-06T21:12:28.603ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3432024-12-06T21:12:28.603ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3442024-12-06T21:12:28.603ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3452024-12-06T21:12:28.603ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3462024-12-06T21:12:28.603ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-12-06T21:12:28.604ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-12-06T21:12:28.604ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3492024-12-06T21:12:28.623ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
3502024-12-06T21:12:28.636ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-12-06T21:12:28.643ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone file = sled-storage/src/dataset.rs:303
3522024-12-06T21:12:28.803ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 file = sled-storage/src/dataset.rs:389
3532024-12-06T21:12:28.811ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542024-12-06T21:12:28.811ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552024-12-06T21:12:28.811ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562024-12-06T21:12:28.811ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572024-12-06T21:12:28.811ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-12-06T21:12:28.820ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3592024-12-06T21:12:28.820ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 56416138-2c59-4897-b953-6407738ebcfc (zpool)
3602024-12-06T21:12:28.909ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }
3612024-12-06T21:12:28.916ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3622024-12-06T21:12:28.916ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3632024-12-06T21:12:28.916ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3642024-12-06T21:12:28.916ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3652024-12-06T21:12:28.916ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-12-06T21:12:28.917ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-12-06T21:12:28.917ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3682024-12-06T21:12:28.948ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-12-06T21:12:28.955ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_56416138-2c59-4897-b953-6407738ebcfc/crypt/zone file = sled-storage/src/dataset.rs:303
3702024-12-06T21:12:29.118ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_56416138-2c59-4897-b953-6407738ebcfc file = sled-storage/src/dataset.rs:389
3712024-12-06T21:12:29.125ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-12-06T21:12:29.125ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-12-06T21:12:29.125ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-12-06T21:12:29.125ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-12-06T21:12:29.125ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-12-06T21:12:29.136ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3772024-12-06T21:12:29.136ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool)
3782024-12-06T21:12:29.230ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }
3792024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3802024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3812024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3822024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3832024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-12-06T21:12:29.238ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3862024-12-06T21:12:29.274ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-12-06T21:12:29.281ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/zone file = sled-storage/src/dataset.rs:303
3882024-12-06T21:12:29.457ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1cb341c5-34e8-451b-86cd-f466ef64d711 file = sled-storage/src/dataset.rs:389
3892024-12-06T21:12:29.465ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3902024-12-06T21:12:29.465ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3912024-12-06T21:12:29.465ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3922024-12-06T21:12:29.465ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3932024-12-06T21:12:29.465ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3942024-12-06T21:12:29.475ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3952024-12-06T21:12:29.475ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool)
3962024-12-06T21:12:29.575ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }
3972024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
3982024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
3992024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4002024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4012024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-12-06T21:12:29.583ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4042024-12-06T21:12:29.618ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4052024-12-06T21:12:29.625ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4062024-12-06T21:12:29.626ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone file = sled-storage/src/dataset.rs:303
4072024-12-06T21:12:29.810ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae file = sled-storage/src/dataset.rs:389
4082024-12-06T21:12:29.818ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092024-12-06T21:12:29.818ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102024-12-06T21:12:29.818ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112024-12-06T21:12:29.818ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122024-12-06T21:12:29.818ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132024-12-06T21:12:29.828ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4142024-12-06T21:12:29.828ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool)
4152024-12-06T21:12:29.921ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }
4162024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4172024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4182024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4192024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4202024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-12-06T21:12:29.928ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4232024-12-06T21:12:29.966ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-12-06T21:12:29.973ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone file = sled-storage/src/dataset.rs:303
4252024-12-06T21:12:30.151ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c file = sled-storage/src/dataset.rs:389
4262024-12-06T21:12:30.159ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272024-12-06T21:12:30.159ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282024-12-06T21:12:30.159ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-12-06T21:12:30.160ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cee4e847-3bb9-425f-a5d6-c199bac4aab1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4dcbd7ec-2d12-40b3-92d5-d9548d93b746 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302024-12-06T21:12:30.160ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312024-12-06T21:12:30.160ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322024-12-06T21:12:30.160ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4342024-12-06T21:12:30.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4352024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4362024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4372024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4382024-12-06T21:12:30.160ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4392024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4402024-12-06T21:12:30.160ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4412024-12-06T21:12:30.160ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4422024-12-06T21:12:30.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3019173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33751 req_id = 6989be07-8877-4fc7-833f-2871321a275c response_code = 200 uri = /omicron-physical-disks
4432024-12-06T21:12:30.192ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0406b9d3-4777-4a45-a386-6c22b2cad3c9 (dataset): DatasetConfig { id: 0406b9d3-4777-4a45-a386-6c22b2cad3c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 060dc06a-04ee-4876-9933-3988386e32c1 (dataset): DatasetConfig { id: 060dc06a-04ee-4876-9933-3988386e32c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0be88f21-5dc1-4ed6-859d-2fc66d1ebae2 (dataset): DatasetConfig { id: 0be88f21-5dc1-4ed6-859d-2fc66d1ebae2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dfe590e-4b44-477c-9e4a-970f49c7e386 (dataset): DatasetConfig { id: 0dfe590e-4b44-477c-9e4a-970f49c7e386 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eebddd1-ad3f-47a2-b96b-51b976469bc6 (dataset): DatasetConfig { id: 0eebddd1-ad3f-47a2-b96b-51b976469bc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d44547-889a-4611-8f0a-45fe8c2b6cc6 (dataset): DatasetConfig { id: 14d44547-889a-4611-8f0a-45fe8c2b6cc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a21a5d5-2976-441e-9f42-80cec6cbb532 (dataset): DatasetConfig { id: 1a21a5d5-2976-441e-9f42-80cec6cbb532 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21ad3826-e0f1-4010-a8fa-33cc3045e3ad (dataset): DatasetConfig { id: 21ad3826-e0f1-4010-a8fa-33cc3045e3ad (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24f1aec1-a487-4847-8b61-675a2a81ffdd (dataset): DatasetConfig { id: 24f1aec1-a487-4847-8b61-675a2a81ffdd (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 313fbf10-7a52-46dc-880c-1507a6c2bf01 (dataset): DatasetConfig { id: 313fbf10-7a52-46dc-880c-1507a6c2bf01 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37324a40-1392-4940-bfa7-d85c09b50c38 (dataset): DatasetConfig { id: 37324a40-1392-4940-bfa7-d85c09b50c38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c191371-b20b-4017-8e40-cd12e1d1da7b (dataset): DatasetConfig { id: 3c191371-b20b-4017-8e40-cd12e1d1da7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cba1d22-a1bd-4ff6-b1c9-81d4ef02a580 (dataset): DatasetConfig { id: 3cba1d22-a1bd-4ff6-b1c9-81d4ef02a580 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e6b673d-7ef5-4ca2-8a0b-e3d7829e2621 (dataset): DatasetConfig { id: 3e6b673d-7ef5-4ca2-8a0b-e3d7829e2621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43136bca-da65-4bef-9b99-a3aa2edb54fa (dataset): DatasetConfig { id: 43136bca-da65-4bef-9b99-a3aa2edb54fa (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 496badc0-6d65-4aca-b2ea-bea13620141f (dataset): DatasetConfig { id: 496badc0-6d65-4aca-b2ea-bea13620141f (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 49f0d705-ee85-4a6e-bfa9-9f56f430cc7c (dataset): DatasetConfig { id: 49f0d705-ee85-4a6e-bfa9-9f56f430cc7c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49f3e2d5-4b3c-42a6-bc8f-42ed2f5e60da (dataset): DatasetConfig { id: 49f3e2d5-4b3c-42a6-bc8f-42ed2f5e60da (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af62a77-afa7-45c0-88df-85051c7ae05b (dataset): DatasetConfig { id: 4af62a77-afa7-45c0-88df-85051c7ae05b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b603a54-60b7-4acd-850e-33ba6188a166 (dataset): DatasetConfig { id: 4b603a54-60b7-4acd-850e-33ba6188a166 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b945a3e-e211-4d2e-a19e-8dcc6e42ca8a (dataset): DatasetConfig { id: 4b945a3e-e211-4d2e-a19e-8dcc6e42ca8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56c3b444-c22e-41e7-aa1f-c364ca909923 (dataset): DatasetConfig { id: 56c3b444-c22e-41e7-aa1f-c364ca909923 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c363cfa-3c21-49be-8f3f-793fb8dac9c6 (dataset): DatasetConfig { id: 5c363cfa-3c21-49be-8f3f-793fb8dac9c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61c53b7b-7e2d-48f5-a6f9-6ae56abc0902 (dataset): DatasetConfig { id: 61c53b7b-7e2d-48f5-a6f9-6ae56abc0902 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64313ba3-ffc9-4451-a1e9-d2debe7ddebf (dataset): DatasetConfig { id: 64313ba3-ffc9-4451-a1e9-d2debe7ddebf (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65454bd8-aa54-4b02-82e9-06abe7523bd2 (dataset): DatasetConfig { id: 65454bd8-aa54-4b02-82e9-06abe7523bd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682b8bd0-f73a-4810-9d9d-ebb07efeed5e (dataset): DatasetConfig { id: 682b8bd0-f73a-4810-9d9d-ebb07efeed5e (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6e5751a8-3e60-468a-922e-7943fe58a923 (dataset): DatasetConfig { id: 6e5751a8-3e60-468a-922e-7943fe58a923 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f627278-6100-47bb-9da4-3a82e167aefc (dataset): DatasetConfig { id: 6f627278-6100-47bb-9da4-3a82e167aefc (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f9a3e32-02d8-4ff5-9327-05b008b3c144 (dataset): DatasetConfig { id: 6f9a3e32-02d8-4ff5-9327-05b008b3c144 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 729670d6-e5de-481d-82f9-527042abe5cd (dataset): DatasetConfig { id: 729670d6-e5de-481d-82f9-527042abe5cd (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7ffbb040-7883-4114-995d-219a67a95ff5 (dataset): DatasetConfig { id: 7ffbb040-7883-4114-995d-219a67a95ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8009d69b-c599-4a93-8d04-03cf9a322fc2 (dataset): DatasetConfig { id: 8009d69b-c599-4a93-8d04-03cf9a322fc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83052cde-d986-40e1-af2a-9f0e76acdde5 (dataset): DatasetConfig { id: 83052cde-d986-40e1-af2a-9f0e76acdde5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8305fa5d-9e41-493c-9164-34372bc8bcd4 (dataset): DatasetConfig { id: 8305fa5d-9e41-493c-9164-34372bc8bcd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f7f7afe-8e2f-4665-ad4c-93502c3c5e8f (dataset): DatasetConfig { id: 8f7f7afe-8e2f-4665-ad4c-93502c3c5e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90d5cd8a-4473-43bc-a5e0-97d4ee85398b (dataset): DatasetConfig { id: 90d5cd8a-4473-43bc-a5e0-97d4ee85398b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 96f8e0fe-ec2b-4f14-8abe-0729d7c845d6 (dataset): DatasetConfig { id: 96f8e0fe-ec2b-4f14-8abe-0729d7c845d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d6b63a0-323f-479d-a23d-583ccb9b46f4 (dataset): DatasetConfig { id: 9d6b63a0-323f-479d-a23d-583ccb9b46f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f880762-8519-406c-8308-bf47e706ad29 (dataset): DatasetConfig { id: 9f880762-8519-406c-8308-bf47e706ad29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34ec0af-0651-4f14-bf7d-ba026ca686e5 (dataset): DatasetConfig { id: a34ec0af-0651-4f14-bf7d-ba026ca686e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3b49c4c-8cb2-4de3-84d0-9d534843b06b (dataset): DatasetConfig { id: a3b49c4c-8cb2-4de3-84d0-9d534843b06b (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4b0bf5c-45df-4d2b-8e11-06aed5de9cd7 (dataset): DatasetConfig { id: a4b0bf5c-45df-4d2b-8e11-06aed5de9cd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a648e3e4-03b3-4bbe-88c2-97ab639732ce (dataset): DatasetConfig { id: a648e3e4-03b3-4bbe-88c2-97ab639732ce (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9a33bbc-84e2-4a7d-a231-d7f6b431c702 (dataset): DatasetConfig { id: a9a33bbc-84e2-4a7d-a231-d7f6b431c702 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac097490-48a7-4d79-b415-4a3f75e26c9c (dataset): DatasetConfig { id: ac097490-48a7-4d79-b415-4a3f75e26c9c (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adf6d791-13c4-4937-917a-b6472c3fbfdb (dataset): DatasetConfig { id: adf6d791-13c4-4937-917a-b6472c3fbfdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aef8f1ce-2093-4047-b04c-6e3049d6ea94 (dataset): DatasetConfig { id: aef8f1ce-2093-4047-b04c-6e3049d6ea94 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2962b63-c94d-4682-99f3-253426d627ca (dataset): DatasetConfig { id: b2962b63-c94d-4682-99f3-253426d627ca (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b56f84e2-0310-4778-be96-714fd6efad0d (dataset): DatasetConfig { id: b56f84e2-0310-4778-be96-714fd6efad0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69d4894-e5fe-4ae3-9e64-fd2b13cab2b4 (dataset): DatasetConfig { id: b69d4894-e5fe-4ae3-9e64-fd2b13cab2b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b869b762-bff5-4d75-a095-73df16476965 (dataset): DatasetConfig { id: b869b762-bff5-4d75-a095-73df16476965 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8878a6e-faab-46d6-b900-e1ae381a1d02 (dataset): DatasetConfig { id: b8878a6e-faab-46d6-b900-e1ae381a1d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc4e6474-bc61-47db-ad0d-bbbd6926abb7 (dataset): DatasetConfig { id: bc4e6474-bc61-47db-ad0d-bbbd6926abb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf361609-fdea-4373-bd37-5512b8d7e171 (dataset): DatasetConfig { id: bf361609-fdea-4373-bd37-5512b8d7e171 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0d7c4dc-308b-4f2d-b581-d56713731194 (dataset): DatasetConfig { id: c0d7c4dc-308b-4f2d-b581-d56713731194 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c30a5067-83ca-4d54-a90f-9a1d943099aa (dataset): DatasetConfig { id: c30a5067-83ca-4d54-a90f-9a1d943099aa (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c42c1dde-b429-4ca8-8a3f-55e1b8a40edf (dataset): DatasetConfig { id: c42c1dde-b429-4ca8-8a3f-55e1b8a40edf (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cac150b4-8266-4087-8c8a-9b0b6470509d (dataset): DatasetConfig { id: cac150b4-8266-4087-8c8a-9b0b6470509d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cafea13d-a4b9-4ba4-8e9d-90f1ce4cff1b (dataset): DatasetConfig { id: cafea13d-a4b9-4ba4-8e9d-90f1ce4cff1b (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08d5635-6ada-4654-abee-1f282426f0d5 (dataset): DatasetConfig { id: d08d5635-6ada-4654-abee-1f282426f0d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bf98a2-1131-4b50-82cd-158d7d305cf7 (dataset): DatasetConfig { id: d1bf98a2-1131-4b50-82cd-158d7d305cf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d76c2cb8-8d0b-4dec-9e6c-6c3b72cd76d3 (dataset): DatasetConfig { id: d76c2cb8-8d0b-4dec-9e6c-6c3b72cd76d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb9c7b23-49f1-4ab8-8f21-e8bb58272bab (dataset): DatasetConfig { id: eb9c7b23-49f1-4ab8-8f21-e8bb58272bab (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2eed64e-abdf-4118-956d-842a6b29d9ae (dataset): DatasetConfig { id: f2eed64e-abdf-4118-956d-842a6b29d9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdac9e9c-ad3e-450c-b178-febb16e680c6 (dataset): DatasetConfig { id: fdac9e9c-ad3e-450c-b178-febb16e680c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4442024-12-06T21:12:30.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41477
4452024-12-06T21:12:30.193ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4462024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0406b9d3-4777-4a45-a386-6c22b2cad3c9 (dataset): DatasetConfig { id: 0406b9d3-4777-4a45-a386-6c22b2cad3c9 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 060dc06a-04ee-4876-9933-3988386e32c1 (dataset): DatasetConfig { id: 060dc06a-04ee-4876-9933-3988386e32c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0be88f21-5dc1-4ed6-859d-2fc66d1ebae2 (dataset): DatasetConfig { id: 0be88f21-5dc1-4ed6-859d-2fc66d1ebae2 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0dfe590e-4b44-477c-9e4a-970f49c7e386 (dataset): DatasetConfig { id: 0dfe590e-4b44-477c-9e4a-970f49c7e386 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0eebddd1-ad3f-47a2-b96b-51b976469bc6 (dataset): DatasetConfig { id: 0eebddd1-ad3f-47a2-b96b-51b976469bc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 14d44547-889a-4611-8f0a-45fe8c2b6cc6 (dataset): DatasetConfig { id: 14d44547-889a-4611-8f0a-45fe8c2b6cc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a21a5d5-2976-441e-9f42-80cec6cbb532 (dataset): DatasetConfig { id: 1a21a5d5-2976-441e-9f42-80cec6cbb532 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 21ad3826-e0f1-4010-a8fa-33cc3045e3ad (dataset): DatasetConfig { id: 21ad3826-e0f1-4010-a8fa-33cc3045e3ad (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 24f1aec1-a487-4847-8b61-675a2a81ffdd (dataset): DatasetConfig { id: 24f1aec1-a487-4847-8b61-675a2a81ffdd (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 313fbf10-7a52-46dc-880c-1507a6c2bf01 (dataset): DatasetConfig { id: 313fbf10-7a52-46dc-880c-1507a6c2bf01 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37324a40-1392-4940-bfa7-d85c09b50c38 (dataset): DatasetConfig { id: 37324a40-1392-4940-bfa7-d85c09b50c38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c191371-b20b-4017-8e40-cd12e1d1da7b (dataset): DatasetConfig { id: 3c191371-b20b-4017-8e40-cd12e1d1da7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cba1d22-a1bd-4ff6-b1c9-81d4ef02a580 (dataset): DatasetConfig { id: 3cba1d22-a1bd-4ff6-b1c9-81d4ef02a580 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e6b673d-7ef5-4ca2-8a0b-e3d7829e2621 (dataset): DatasetConfig { id: 3e6b673d-7ef5-4ca2-8a0b-e3d7829e2621 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43136bca-da65-4bef-9b99-a3aa2edb54fa (dataset): DatasetConfig { id: 43136bca-da65-4bef-9b99-a3aa2edb54fa (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 496badc0-6d65-4aca-b2ea-bea13620141f (dataset): DatasetConfig { id: 496badc0-6d65-4aca-b2ea-bea13620141f (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 49f0d705-ee85-4a6e-bfa9-9f56f430cc7c (dataset): DatasetConfig { id: 49f0d705-ee85-4a6e-bfa9-9f56f430cc7c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49f3e2d5-4b3c-42a6-bc8f-42ed2f5e60da (dataset): DatasetConfig { id: 49f3e2d5-4b3c-42a6-bc8f-42ed2f5e60da (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4af62a77-afa7-45c0-88df-85051c7ae05b (dataset): DatasetConfig { id: 4af62a77-afa7-45c0-88df-85051c7ae05b (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b603a54-60b7-4acd-850e-33ba6188a166 (dataset): DatasetConfig { id: 4b603a54-60b7-4acd-850e-33ba6188a166 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4b945a3e-e211-4d2e-a19e-8dcc6e42ca8a (dataset): DatasetConfig { id: 4b945a3e-e211-4d2e-a19e-8dcc6e42ca8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 56c3b444-c22e-41e7-aa1f-c364ca909923 (dataset): DatasetConfig { id: 56c3b444-c22e-41e7-aa1f-c364ca909923 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c363cfa-3c21-49be-8f3f-793fb8dac9c6 (dataset): DatasetConfig { id: 5c363cfa-3c21-49be-8f3f-793fb8dac9c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 61c53b7b-7e2d-48f5-a6f9-6ae56abc0902 (dataset): DatasetConfig { id: 61c53b7b-7e2d-48f5-a6f9-6ae56abc0902 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 64313ba3-ffc9-4451-a1e9-d2debe7ddebf (dataset): DatasetConfig { id: 64313ba3-ffc9-4451-a1e9-d2debe7ddebf (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 65454bd8-aa54-4b02-82e9-06abe7523bd2 (dataset): DatasetConfig { id: 65454bd8-aa54-4b02-82e9-06abe7523bd2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 682b8bd0-f73a-4810-9d9d-ebb07efeed5e (dataset): DatasetConfig { id: 682b8bd0-f73a-4810-9d9d-ebb07efeed5e (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6e5751a8-3e60-468a-922e-7943fe58a923 (dataset): DatasetConfig { id: 6e5751a8-3e60-468a-922e-7943fe58a923 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f627278-6100-47bb-9da4-3a82e167aefc (dataset): DatasetConfig { id: 6f627278-6100-47bb-9da4-3a82e167aefc (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f9a3e32-02d8-4ff5-9327-05b008b3c144 (dataset): DatasetConfig { id: 6f9a3e32-02d8-4ff5-9327-05b008b3c144 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 729670d6-e5de-481d-82f9-527042abe5cd (dataset): DatasetConfig { id: 729670d6-e5de-481d-82f9-527042abe5cd (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7ffbb040-7883-4114-995d-219a67a95ff5 (dataset): DatasetConfig { id: 7ffbb040-7883-4114-995d-219a67a95ff5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8009d69b-c599-4a93-8d04-03cf9a322fc2 (dataset): DatasetConfig { id: 8009d69b-c599-4a93-8d04-03cf9a322fc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 83052cde-d986-40e1-af2a-9f0e76acdde5 (dataset): DatasetConfig { id: 83052cde-d986-40e1-af2a-9f0e76acdde5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8305fa5d-9e41-493c-9164-34372bc8bcd4 (dataset): DatasetConfig { id: 8305fa5d-9e41-493c-9164-34372bc8bcd4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f7f7afe-8e2f-4665-ad4c-93502c3c5e8f (dataset): DatasetConfig { id: 8f7f7afe-8e2f-4665-ad4c-93502c3c5e8f (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 90d5cd8a-4473-43bc-a5e0-97d4ee85398b (dataset): DatasetConfig { id: 90d5cd8a-4473-43bc-a5e0-97d4ee85398b (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 96f8e0fe-ec2b-4f14-8abe-0729d7c845d6 (dataset): DatasetConfig { id: 96f8e0fe-ec2b-4f14-8abe-0729d7c845d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d6b63a0-323f-479d-a23d-583ccb9b46f4 (dataset): DatasetConfig { id: 9d6b63a0-323f-479d-a23d-583ccb9b46f4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9f880762-8519-406c-8308-bf47e706ad29 (dataset): DatasetConfig { id: 9f880762-8519-406c-8308-bf47e706ad29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34ec0af-0651-4f14-bf7d-ba026ca686e5 (dataset): DatasetConfig { id: a34ec0af-0651-4f14-bf7d-ba026ca686e5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3b49c4c-8cb2-4de3-84d0-9d534843b06b (dataset): DatasetConfig { id: a3b49c4c-8cb2-4de3-84d0-9d534843b06b (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a4b0bf5c-45df-4d2b-8e11-06aed5de9cd7 (dataset): DatasetConfig { id: a4b0bf5c-45df-4d2b-8e11-06aed5de9cd7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a648e3e4-03b3-4bbe-88c2-97ab639732ce (dataset): DatasetConfig { id: a648e3e4-03b3-4bbe-88c2-97ab639732ce (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9a33bbc-84e2-4a7d-a231-d7f6b431c702 (dataset): DatasetConfig { id: a9a33bbc-84e2-4a7d-a231-d7f6b431c702 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac097490-48a7-4d79-b415-4a3f75e26c9c (dataset): DatasetConfig { id: ac097490-48a7-4d79-b415-4a3f75e26c9c (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, adf6d791-13c4-4937-917a-b6472c3fbfdb (dataset): DatasetConfig { id: adf6d791-13c4-4937-917a-b6472c3fbfdb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aef8f1ce-2093-4047-b04c-6e3049d6ea94 (dataset): DatasetConfig { id: aef8f1ce-2093-4047-b04c-6e3049d6ea94 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b2962b63-c94d-4682-99f3-253426d627ca (dataset): DatasetConfig { id: b2962b63-c94d-4682-99f3-253426d627ca (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b56f84e2-0310-4778-be96-714fd6efad0d (dataset): DatasetConfig { id: b56f84e2-0310-4778-be96-714fd6efad0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69d4894-e5fe-4ae3-9e64-fd2b13cab2b4 (dataset): DatasetConfig { id: b69d4894-e5fe-4ae3-9e64-fd2b13cab2b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b869b762-bff5-4d75-a095-73df16476965 (dataset): DatasetConfig { id: b869b762-bff5-4d75-a095-73df16476965 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8878a6e-faab-46d6-b900-e1ae381a1d02 (dataset): DatasetConfig { id: b8878a6e-faab-46d6-b900-e1ae381a1d02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc4e6474-bc61-47db-ad0d-bbbd6926abb7 (dataset): DatasetConfig { id: bc4e6474-bc61-47db-ad0d-bbbd6926abb7 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bf361609-fdea-4373-bd37-5512b8d7e171 (dataset): DatasetConfig { id: bf361609-fdea-4373-bd37-5512b8d7e171 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c0d7c4dc-308b-4f2d-b581-d56713731194 (dataset): DatasetConfig { id: c0d7c4dc-308b-4f2d-b581-d56713731194 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c30a5067-83ca-4d54-a90f-9a1d943099aa (dataset): DatasetConfig { id: c30a5067-83ca-4d54-a90f-9a1d943099aa (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c42c1dde-b429-4ca8-8a3f-55e1b8a40edf (dataset): DatasetConfig { id: c42c1dde-b429-4ca8-8a3f-55e1b8a40edf (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cac150b4-8266-4087-8c8a-9b0b6470509d (dataset): DatasetConfig { id: cac150b4-8266-4087-8c8a-9b0b6470509d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cafea13d-a4b9-4ba4-8e9d-90f1ce4cff1b (dataset): DatasetConfig { id: cafea13d-a4b9-4ba4-8e9d-90f1ce4cff1b (dataset), name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d08d5635-6ada-4654-abee-1f282426f0d5 (dataset): DatasetConfig { id: d08d5635-6ada-4654-abee-1f282426f0d5 (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1bf98a2-1131-4b50-82cd-158d7d305cf7 (dataset): DatasetConfig { id: d1bf98a2-1131-4b50-82cd-158d7d305cf7 (dataset), name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d76c2cb8-8d0b-4dec-9e6c-6c3b72cd76d3 (dataset): DatasetConfig { id: d76c2cb8-8d0b-4dec-9e6c-6c3b72cd76d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb9c7b23-49f1-4ab8-8f21-e8bb58272bab (dataset): DatasetConfig { id: eb9c7b23-49f1-4ab8-8f21-e8bb58272bab (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2eed64e-abdf-4118-956d-842a6b29d9ae (dataset): DatasetConfig { id: f2eed64e-abdf-4118-956d-842a6b29d9ae (dataset), name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fdac9e9c-ad3e-450c-b178-febb16e680c6 (dataset): DatasetConfig { id: fdac9e9c-ad3e-450c-b178-febb16e680c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4472024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4482024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4492024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4502024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4512024-12-06T21:12:30.193ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4522024-12-06T21:12:30.285ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4532024-12-06T21:12:30.285ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e" } file = sled-storage/src/manager.rs:1331
4542024-12-06T21:12:30.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4552024-12-06T21:12:30.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380" } file = sled-storage/src/manager.rs:1331
4562024-12-06T21:12:30.484ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4572024-12-06T21:12:30.484ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045" } file = sled-storage/src/manager.rs:1331
4582024-12-06T21:12:30.583ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4592024-12-06T21:12:30.583ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4602024-12-06T21:12:30.628ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4612024-12-06T21:12:30.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622024-12-06T21:12:30.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/debug"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/debug" } file = sled-storage/src/manager.rs:1331
4632024-12-06T21:12:30.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642024-12-06T21:12:30.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4652024-12-06T21:12:30.833ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662024-12-06T21:12:30.833ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4" } file = sled-storage/src/manager.rs:1331
4672024-12-06T21:12:30.933ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682024-12-06T21:12:30.933ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7" } file = sled-storage/src/manager.rs:1331
4692024-12-06T21:12:31.034ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4702024-12-06T21:12:31.034ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crucible" } file = sled-storage/src/manager.rs:1331
4712024-12-06T21:12:31.125ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4722024-12-06T21:12:31.125ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c" } file = sled-storage/src/manager.rs:1331
4732024-12-06T21:12:31.225ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4742024-12-06T21:12:31.226ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone" } file = sled-storage/src/manager.rs:1331
4752024-12-06T21:12:31.294ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4762024-12-06T21:12:31.294ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4772024-12-06T21:12:31.384ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4782024-12-06T21:12:31.384ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible" } file = sled-storage/src/manager.rs:1331
4792024-12-06T21:12:31.471ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4802024-12-06T21:12:31.471ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4812024-12-06T21:12:31.563ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4822024-12-06T21:12:31.563ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/debug"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/debug" } file = sled-storage/src/manager.rs:1331
4832024-12-06T21:12:31.629ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
4842024-12-06T21:12:31.631ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852024-12-06T21:12:31.631ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1" } file = sled-storage/src/manager.rs:1331
4862024-12-06T21:12:31.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872024-12-06T21:12:31.729ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1" } file = sled-storage/src/manager.rs:1331
4882024-12-06T21:12:31.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4892024-12-06T21:12:31.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/zone/oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319"), full_name: "oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/zone/oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319" } file = sled-storage/src/manager.rs:1331
4902024-12-06T21:12:31.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4912024-12-06T21:12:31.926ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crucible" } file = sled-storage/src/manager.rs:1331
4922024-12-06T21:12:32.018ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4932024-12-06T21:12:32.018ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/debug"), full_name: "oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/debug" } file = sled-storage/src/manager.rs:1331
4942024-12-06T21:12:32.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4952024-12-06T21:12:32.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
4962024-12-06T21:12:32.178ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4972024-12-06T21:12:32.178ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crucible" } file = sled-storage/src/manager.rs:1331
4982024-12-06T21:12:32.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4992024-12-06T21:12:32.267ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone" } file = sled-storage/src/manager.rs:1331
5002024-12-06T21:12:32.335ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5012024-12-06T21:12:32.336ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone" } file = sled-storage/src/manager.rs:1331
5022024-12-06T21:12:32.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5032024-12-06T21:12:32.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56416138-2c59-4897-b953-6407738ebcfc/crypt/zone"), full_name: "oxp_56416138-2c59-4897-b953-6407738ebcfc/crypt/zone" } file = sled-storage/src/manager.rs:1331
5042024-12-06T21:12:32.473ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5052024-12-06T21:12:32.473ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/debug"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/debug" } file = sled-storage/src/manager.rs:1331
5062024-12-06T21:12:32.543ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5072024-12-06T21:12:32.543ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone" } file = sled-storage/src/manager.rs:1331
5082024-12-06T21:12:32.613ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5092024-12-06T21:12:32.613ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2" } file = sled-storage/src/manager.rs:1331
5102024-12-06T21:12:32.632ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5112024-12-06T21:12:32.714ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5122024-12-06T21:12:32.714ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016" } file = sled-storage/src/manager.rs:1331
5132024-12-06T21:12:32.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5142024-12-06T21:12:32.813ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/debug"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/debug" } file = sled-storage/src/manager.rs:1331
5152024-12-06T21:12:32.882ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5162024-12-06T21:12:32.882ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5172024-12-06T21:12:32.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5182024-12-06T21:12:32.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371" } file = sled-storage/src/manager.rs:1331
5192024-12-06T21:12:33.073ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5202024-12-06T21:12:33.073ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5212024-12-06T21:12:33.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5222024-12-06T21:12:33.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476" } file = sled-storage/src/manager.rs:1331
5232024-12-06T21:12:33.263ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5242024-12-06T21:12:33.263ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crucible" } file = sled-storage/src/manager.rs:1331
5252024-12-06T21:12:33.351ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5262024-12-06T21:12:33.351ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/debug"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/debug" } file = sled-storage/src/manager.rs:1331
5272024-12-06T21:12:33.419ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5282024-12-06T21:12:33.419ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone" } file = sled-storage/src/manager.rs:1331
5292024-12-06T21:12:33.487ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302024-12-06T21:12:33.487ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crucible" } file = sled-storage/src/manager.rs:1331
5312024-12-06T21:12:33.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322024-12-06T21:12:33.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/zone"), full_name: "oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/zone" } file = sled-storage/src/manager.rs:1331
5332024-12-06T21:12:33.634ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5342024-12-06T21:12:33.649ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5352024-12-06T21:12:33.649ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187" } file = sled-storage/src/manager.rs:1331
5362024-12-06T21:12:33.660ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 21.646536303s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5372024-12-06T21:12:33.749ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382024-12-06T21:12:33.749ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307" } file = sled-storage/src/manager.rs:1331
5392024-12-06T21:12:33.847ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402024-12-06T21:12:33.847ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56416138-2c59-4897-b953-6407738ebcfc/crypt/debug"), full_name: "oxp_56416138-2c59-4897-b953-6407738ebcfc/crypt/debug" } file = sled-storage/src/manager.rs:1331
5412024-12-06T21:12:33.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422024-12-06T21:12:33.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
5432024-12-06T21:12:34.007ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5442024-12-06T21:12:34.007ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927" } file = sled-storage/src/manager.rs:1331
5452024-12-06T21:12:34.111ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462024-12-06T21:12:34.111ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crucible" } file = sled-storage/src/manager.rs:1331
5472024-12-06T21:12:34.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482024-12-06T21:12:34.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41" } file = sled-storage/src/manager.rs:1331
5492024-12-06T21:12:34.301ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5502024-12-06T21:12:34.301ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone" } file = sled-storage/src/manager.rs:1331
5512024-12-06T21:12:34.371ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5522024-12-06T21:12:34.371ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5532024-12-06T21:12:34.461ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5542024-12-06T21:12:34.461ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone" } file = sled-storage/src/manager.rs:1331
5552024-12-06T21:12:34.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5562024-12-06T21:12:34.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/debug"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/debug" } file = sled-storage/src/manager.rs:1331
5572024-12-06T21:12:34.600ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5582024-12-06T21:12:34.600ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be"), full_name: "oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/zone/oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be" } file = sled-storage/src/manager.rs:1331
5592024-12-06T21:12:34.639ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5602024-12-06T21:12:34.724ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612024-12-06T21:12:34.724ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/56416138-2c59-4897-b953-6407738ebcfc/crypt/zone/oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50"), full_name: "oxp_56416138-2c59-4897-b953-6407738ebcfc/crypt/zone/oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50" } file = sled-storage/src/manager.rs:1331
5622024-12-06T21:12:34.828ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632024-12-06T21:12:34.828ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crucible" } file = sled-storage/src/manager.rs:1331
5642024-12-06T21:12:34.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5652024-12-06T21:12:34.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53" } file = sled-storage/src/manager.rs:1331
5662024-12-06T21:12:35.017ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5672024-12-06T21:12:35.017ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/debug"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/debug" } file = sled-storage/src/manager.rs:1331
5682024-12-06T21:12:35.086ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692024-12-06T21:12:35.086ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
5702024-12-06T21:12:35.176ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5712024-12-06T21:12:35.176ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3" } file = sled-storage/src/manager.rs:1331
5722024-12-06T21:12:35.277ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5732024-12-06T21:12:35.277ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156"), full_name: "oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/zone/oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156" } file = sled-storage/src/manager.rs:1331
5742024-12-06T21:12:35.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5752024-12-06T21:12:35.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5"), full_name: "oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/zone/oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5" } file = sled-storage/src/manager.rs:1331
5762024-12-06T21:12:35.480ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772024-12-06T21:12:35.480ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/zone/oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3" } file = sled-storage/src/manager.rs:1331
5782024-12-06T21:12:35.584ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5792024-12-06T21:12:35.584ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77"), full_name: "oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crypt/zone/oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77" } file = sled-storage/src/manager.rs:1331
5802024-12-06T21:12:35.643ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5812024-12-06T21:12:35.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5822024-12-06T21:12:35.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9"), full_name: "oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/zone/oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9" } file = sled-storage/src/manager.rs:1331
5832024-12-06T21:12:35.789ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5842024-12-06T21:12:35.789ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea" } file = sled-storage/src/manager.rs:1331
5852024-12-06T21:12:35.886ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5862024-12-06T21:12:35.886ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crucible" } file = sled-storage/src/manager.rs:1331
5872024-12-06T21:12:35.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5882024-12-06T21:12:35.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236"), full_name: "oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/zone/oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236" } file = sled-storage/src/manager.rs:1331
5892024-12-06T21:12:36.024ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5902024-12-06T21:12:36.024ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5912024-12-06T21:12:36.031ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5922024-12-06T21:12:36.031ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5932024-12-06T21:12:36.084ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5942024-12-06T21:12:36.084ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
5952024-12-06T21:12:36.084ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
5962024-12-06T21:12:36.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5891885 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41477 req_id = 0d8e88bb-3086-4425-aaa8-98fa9d98d4d6 response_code = 200 uri = /datasets
5972024-12-06T21:12:36.138ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
5982024-12-06T21:12:36.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64093
5992024-12-06T21:12:36.139ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6002024-12-06T21:12:36.139ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6012024-12-06T21:12:36.174ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6022024-12-06T21:12:36.174ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6032024-12-06T21:12:36.190ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
6042024-12-06T21:12:36.190ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
6052024-12-06T21:12:36.211ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6062024-12-06T21:12:36.211ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6072024-12-06T21:12:36.237ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
6082024-12-06T21:12:36.237ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
6092024-12-06T21:12:36.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6102024-12-06T21:12:36.244ZINFOSledAgent (ServiceManager): No ledger in /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:188
6112024-12-06T21:12:36.244ZINFOSledAgent (ServiceManager): No ledger in /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:188
6122024-12-06T21:12:36.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6132024-12-06T21:12:36.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6142024-12-06T21:12:36.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6152024-12-06T21:12:36.295ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6162024-12-06T21:12:36.297ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
6172024-12-06T21:12:36.297ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
6182024-12-06T21:12:36.319ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
6192024-12-06T21:12:36.319ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
6202024-12-06T21:12:36.357ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1 file = illumos-utils/src/zone.rs:325
6212024-12-06T21:12:36.361ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3 file = illumos-utils/src/zone.rs:325
6222024-12-06T21:12:36.368ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2 file = illumos-utils/src/zone.rs:325
6232024-12-06T21:12:36.379ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1 file = illumos-utils/src/zone.rs:363
6242024-12-06T21:12:36.384ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3 file = illumos-utils/src/zone.rs:363
6252024-12-06T21:12:36.392ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2 file = illumos-utils/src/zone.rs:363
6262024-12-06T21:12:36.399ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
6272024-12-06T21:12:36.399ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
6282024-12-06T21:12:36.508ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
6292024-12-06T21:12:36.508ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6302024-12-06T21:12:36.554ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6312024-12-06T21:12:36.554ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/nexus.rs:527 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6322024-12-06T21:12:36.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 805366775557969452 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6332024-12-06T21:12:36.590ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18327707354023341125 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6342024-12-06T21:12:36.591ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6352024-12-06T21:12:36.591ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
6362024-12-06T21:12:36.592ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
6372024-12-06T21:12:36.592ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
6382024-12-06T21:12:36.637ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
6392024-12-06T21:12:36.648ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/cbc5c1c6-5668-455a-85ef-94f4aebe0f80) file = sled-agent/src/probe_manager.rs:231 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6402024-12-06T21:12:36.711ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6412024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6422024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6432024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6442024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6452024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6462024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6472024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6482024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6492024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6502024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6512024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6522024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6532024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6542024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6552024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6562024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6572024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6582024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6592024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6602024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6612024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6622024-12-06T21:12:36.711ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6632024-12-06T21:12:37.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17817982598274688407 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6642024-12-06T21:12:37.054ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257920911906253608 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
6652024-12-06T21:12:37.999ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6662024-12-06T21:12:37.999ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6672024-12-06T21:12:37.999ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6682024-12-06T21:12:38.488ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6692024-12-06T21:12:38.975ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6702024-12-06T21:12:38.975ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6712024-12-06T21:12:38.975ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6722024-12-06T21:12:38.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 33.583215ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6732024-12-06T21:12:38.983ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6742024-12-06T21:12:38.986ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6752024-12-06T21:12:39.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 59.42502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6762024-12-06T21:12:39.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 298.989903ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6772024-12-06T21:12:39.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 74.666185ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6782024-12-06T21:12:39.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 56.73278ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6792024-12-06T21:12:39.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 98.616123ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6802024-12-06T21:12:39.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 89.026761ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6812024-12-06T21:12:39.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 255.459473ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6822024-12-06T21:12:39.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 305.526824ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6832024-12-06T21:12:39.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 138.728659ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6842024-12-06T21:12:39.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 563.774619ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6852024-12-06T21:12:39.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 556.434516ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6862024-12-06T21:12:39.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 1.139316577s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6872024-12-06T21:12:40.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 954.984764ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6882024-12-06T21:12:40.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 954.905372ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6892024-12-06T21:12:40.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 1.324577486s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6902024-12-06T21:12:41.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 733.821624ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6912024-12-06T21:12:41.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 969.169127ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6922024-12-06T21:12:41.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 533.53071ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6932024-12-06T21:12:42.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 775.045686ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6942024-12-06T21:12:42.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 960.596173ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6952024-12-06T21:12:42.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 1.355583319s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6962024-12-06T21:12:43.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2") failed: Property not found. retry in 1.056274859s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
6972024-12-06T21:12:43.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1") failed: Property not found. retry in 860.575699ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
6982024-12-06T21:12:43.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3") failed: Property not found. retry in 1.238807923s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
6992024-12-06T21:12:45.102ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_4dccdb26-9cf9-40aa-9229-5d35905cf0e1
7002024-12-06T21:12:45.102ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_79d475dc-44ec-44f4-9e51-ea8a753c39f3
7012024-12-06T21:12:45.102ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_4aff1ae3-2d71-40bf-bc46-79a7276da3c2
7022024-12-06T21:12:45.102ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7032024-12-06T21:12:45.102ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7042024-12-06T21:12:45.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8964204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:64093 req_id = 5c5969fc-3f2b-408d-9dbb-b00d6aae4497 response_code = 204 uri = /omicron-zones
7052024-12-06T21:12:45.105ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7062024-12-06T21:12:45.151ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7072024-12-06T21:12:45.204ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7082024-12-06T21:12:45.251ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7092024-12-06T21:12:45.251ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7102024-12-06T21:12:45.282ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7112024-12-06T21:12:45.282ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7122024-12-06T21:12:45.282ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7132024-12-06T21:12:45.311ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c (service), filesystem_pool: Some(ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ab80bb76-7448-43ce-8e58-a6e11c319aab, kind: Service { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c }, name: Name("ntp-56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 103])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7142024-12-06T21:12:45.312ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51466
7152024-12-06T21:12:45.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7162024-12-06T21:12:45.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7172024-12-06T21:12:45.350ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7182024-12-06T21:12:45.350ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7192024-12-06T21:12:45.386ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7202024-12-06T21:12:45.386ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7212024-12-06T21:12:45.420ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7222024-12-06T21:12:45.420ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
7232024-12-06T21:12:45.420ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
7242024-12-06T21:12:45.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7252024-12-06T21:12:45.432ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7262024-12-06T21:12:45.464ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7272024-12-06T21:12:45.465ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7282024-12-06T21:12:45.465ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7292024-12-06T21:12:45.494ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 215, 103]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7302024-12-06T21:12:45.494ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7312024-12-06T21:12:45.494ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7322024-12-06T21:12:45.494ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7332024-12-06T21:12:45.495ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7342024-12-06T21:12:45.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7352024-12-06T21:12:45.521ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c file = illumos-utils/src/zone.rs:325
7362024-12-06T21:12:45.540ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c file = illumos-utils/src/zone.rs:363
7372024-12-06T21:12:46.152ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7382024-12-06T21:12:46.152ZINFOSledAgent (ServiceManager): Booting oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7392024-12-06T21:12:46.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 39.424574ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7402024-12-06T21:12:46.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 75.397096ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7412024-12-06T21:12:46.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 111.598681ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7422024-12-06T21:12:46.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 557.421195ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7432024-12-06T21:12:46.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 805366775557969452 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7442024-12-06T21:12:46.592ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18327707354023341125 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7452024-12-06T21:12:47.056ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17817982598274688407 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7462024-12-06T21:12:47.056ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257920911906253608 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7472024-12-06T21:12:47.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 857.64812ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7482024-12-06T21:12:47.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 1.188910698s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7492024-12-06T21:12:49.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 1.123172555s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7502024-12-06T21:12:50.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c") failed: Property not found. retry in 1.400260614s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7512024-12-06T21:12:51.732ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c
7522024-12-06T21:12:51.732ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7532024-12-06T21:12:51.732ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7542024-12-06T21:12:51.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6420622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51466 req_id = 27ae7baa-fb09-4b87-a134-bfd18a8ca51a response_code = 204 uri = /omicron-zones
7552024-12-06T21:12:51.735ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7562024-12-06T21:12:51.766ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7572024-12-06T21:12:51.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64826
7582024-12-06T21:12:51.775ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7592024-12-06T21:12:51.775ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8684 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64826 req_id = ed82acfb-ec27-4d74-b730-0f510bbc81c0 response_code = 500 uri = /timesync
7602024-12-06T21:12:51.777ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7612024-12-06T21:12:51.922ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7622024-12-06T21:12:51.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62981
7632024-12-06T21:12:54.119ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3698741705676741771 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7642024-12-06T21:12:54.141ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5636386761393678985 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7652024-12-06T21:12:55.106ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15635612392037680375 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7662024-12-06T21:12:55.931ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7672024-12-06T21:12:55.931ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008258 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62981 req_id = 7c7056d4-d22e-4de6-b881-a7c2636990e7 response_code = 500 uri = /timesync
7682024-12-06T21:12:55.933ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7692024-12-06T21:12:56.103ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7702024-12-06T21:12:56.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40103
7712024-12-06T21:12:56.112ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7722024-12-06T21:12:56.112ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40103 req_id = 0b0dcad6-94bf-4472-9f2a-8d10b52c5361 response_code = 500 uri = /timesync
7732024-12-06T21:12:56.115ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7742024-12-06T21:12:56.290ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7752024-12-06T21:12:56.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46222
7762024-12-06T21:13:00.032ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7772024-12-06T21:13:00.032ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009442 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46222 req_id = 8fa6131f-46ee-4f42-9500-0f6c6e398013 response_code = 500 uri = /timesync
7782024-12-06T21:13:00.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 805366775557969452 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7792024-12-06T21:13:00.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18327707354023341125 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7802024-12-06T21:13:00.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17817982598274688407 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7812024-12-06T21:13:00.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257920911906253608 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
7822024-12-06T21:13:00.035ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7832024-12-06T21:13:00.273ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7842024-12-06T21:13:00.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59075
7852024-12-06T21:13:00.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10443 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59075 req_id = 4e2b6d35-cf1c-4249-9eed-04d2b02469ba response_code = 200 uri = /timesync
7862024-12-06T21:13:00.287ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7872024-12-06T21:13:00.287ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7882024-12-06T21:13:00.557ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7892024-12-06T21:13:00.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34746
7902024-12-06T21:13:00.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7538 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34746 req_id = 7e87961b-bd20-4813-bf96-f7563ab95265 response_code = 200 uri = /timesync
7912024-12-06T21:13:00.567ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.080827624 } file = sled-agent/src/rack_setup/service.rs:743
7922024-12-06T21:13:00.567ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7932024-12-06T21:13:00.782ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7942024-12-06T21:13:00.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65107
7952024-12-06T21:13:00.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65107 req_id = 702f99a3-5ae2-4cd0-afda-936139536c7e response_code = 200 uri = /timesync
7962024-12-06T21:13:00.792ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.080217078 } file = sled-agent/src/rack_setup/service.rs:743
7972024-12-06T21:13:00.792ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7982024-12-06T21:13:01.264ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7992024-12-06T21:13:01.265ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42493
8002024-12-06T21:13:01.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8531 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42493 req_id = 70f0d132-bbf7-40b5-ae03-ee14d8f0178f response_code = 200 uri = /timesync
8012024-12-06T21:13:01.276ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.078914009 } file = sled-agent/src/rack_setup/service.rs:743
8022024-12-06T21:13:01.276ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8032024-12-06T21:13:01.469ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2531304830811242236 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8042024-12-06T21:13:01.469ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9080744220486634789 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8052024-12-06T21:13:01.564ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8062024-12-06T21:13:01.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55651
8072024-12-06T21:13:01.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55651 req_id = fb54ffbd-eb74-47ce-a599-c20387f4df5f response_code = 200 uri = /timesync
8082024-12-06T21:13:01.576ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.080873184 } file = sled-agent/src/rack_setup/service.rs:743
8092024-12-06T21:13:01.576ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8102024-12-06T21:13:02.092ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8112024-12-06T21:13:02.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39150
8122024-12-06T21:13:02.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39150 req_id = e17e420c-8178-452d-a7b6-deb3077b1dc8 response_code = 200 uri = /timesync
8132024-12-06T21:13:02.103ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.079448119 } file = sled-agent/src/rack_setup/service.rs:743
8142024-12-06T21:13:02.103ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8152024-12-06T21:13:02.413ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8162024-12-06T21:13:02.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57795
8172024-12-06T21:13:02.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9379 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57795 req_id = bd93470d-36ee-4b09-a0c0-90ab890a738f response_code = 200 uri = /timesync
8182024-12-06T21:13:02.425ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519582.1533597, correction: 0.077697977 } file = sled-agent/src/rack_setup/service.rs:743
8192024-12-06T21:13:02.425ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8202024-12-06T21:13:03.081ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212024-12-06T21:13:03.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41598
8222024-12-06T21:13:03.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41598 req_id = 33a43650-2c78-485f-ad7b-b22d7feef5e6 response_code = 200 uri = /timesync
8232024-12-06T21:13:03.093ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.075898282 } file = sled-agent/src/rack_setup/service.rs:743
8242024-12-06T21:13:03.093ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252024-12-06T21:13:03.861ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3698741705676741771 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8262024-12-06T21:13:03.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5636386761393678985 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8272024-12-06T21:13:04.030ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282024-12-06T21:13:04.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40409
8292024-12-06T21:13:04.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40409 req_id = a5dffd74-3697-43c0-8690-693cc8208287 response_code = 200 uri = /timesync
8302024-12-06T21:13:04.041ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.072474055 } file = sled-agent/src/rack_setup/service.rs:743
8312024-12-06T21:13:04.041ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322024-12-06T21:13:04.851ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15635612392037680375 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8332024-12-06T21:13:05.341ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342024-12-06T21:13:05.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46819
8352024-12-06T21:13:05.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9468 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46819 req_id = 9c41278b-c053-417e-aab4-877183c48ace response_code = 200 uri = /timesync
8362024-12-06T21:13:05.355ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1733519579.4784026, correction: 0.068337232 } file = sled-agent/src/rack_setup/service.rs:743
8372024-12-06T21:13:05.355ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382024-12-06T21:13:05.988ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35666
8392024-12-06T21:13:05.989ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35666 req_id = 16388e7a-3b04-488e-a339-291dba50178a response_code = 200 uri = /baseboard
8402024-12-06T21:13:06.706ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412024-12-06T21:13:06.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43486
8422024-12-06T21:13:06.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43486 req_id = 01a37fdc-dda4-4b58-b956-e4a8401cb0d0 response_code = 200 uri = /timesync
8432024-12-06T21:13:06.718ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519586.0213542, correction: 0.064250305 } file = sled-agent/src/rack_setup/service.rs:743
8442024-12-06T21:13:06.718ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452024-12-06T21:13:07.415ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8462024-12-06T21:13:07.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40025
8472024-12-06T21:13:07.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40025 req_id = 9762a471-aedf-411d-8ab7-98e07f26d418 response_code = 200 uri = /timesync
8482024-12-06T21:13:07.429ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519587.2423, correction: 0.062490687 } file = sled-agent/src/rack_setup/service.rs:743
8492024-12-06T21:13:07.429ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502024-12-06T21:13:09.315ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512024-12-06T21:13:09.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51787
8522024-12-06T21:13:09.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51787 req_id = b4a06e03-29d0-4917-86bb-e08250396c6f response_code = 200 uri = /timesync
8532024-12-06T21:13:09.326ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519588.2462592, correction: 0.057538137 } file = sled-agent/src/rack_setup/service.rs:743
8542024-12-06T21:13:09.326ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552024-12-06T21:13:10.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 805366775557969452 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8562024-12-06T21:13:10.060ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18327707354023341125 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8572024-12-06T21:13:10.061ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17817982598274688407 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8582024-12-06T21:13:10.061ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14257920911906253608 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8592024-12-06T21:13:10.100ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 285.650439ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8602024-12-06T21:13:10.980ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612024-12-06T21:13:10.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61983
8622024-12-06T21:13:10.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61983 req_id = a4787222-f8a8-4726-91df-d6416d8c2c1b response_code = 200 uri = /timesync
8632024-12-06T21:13:10.993ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519590.0368714, correction: 0.052210186 } file = sled-agent/src/rack_setup/service.rs:743
8642024-12-06T21:13:10.993ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652024-12-06T21:13:11.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2531304830811242236 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8662024-12-06T21:13:11.498ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9080744220486634789 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
8672024-12-06T21:13:12.810ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8682024-12-06T21:13:12.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58155
8692024-12-06T21:13:12.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58155 req_id = 80e11323-a662-44fb-879d-dd5ee1f71883 response_code = 200 uri = /timesync
8702024-12-06T21:13:12.835ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1097084582, ip_addr: 65.100.46.166, stratum: 2, ref_time: 1733519592.4328256, correction: 0.047264054 } file = sled-agent/src/rack_setup/service.rs:743
8712024-12-06T21:13:12.835ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8722024-12-06T21:13:12.864ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c (service), filesystem_pool: Some(ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ab80bb76-7448-43ce-8e58-a6e11c319aab, kind: Service { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c }, name: Name("ntp-56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 103])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } } } }, OmicronZoneConfig { id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77 (service), filesystem_pool: Some(ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External } } } }, OmicronZoneConfig { id: 539a083e-1490-43d7-a48e-aa74e2071476 (service), filesystem_pool: Some(ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8732024-12-06T21:13:12.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54823
8742024-12-06T21:13:12.865ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8752024-12-06T21:13:12.865ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
8762024-12-06T21:13:12.900ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8772024-12-06T21:13:12.900ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8782024-12-06T21:13:12.936ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
8792024-12-06T21:13:12.936ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8802024-12-06T21:13:12.970ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8812024-12-06T21:13:12.970ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
8822024-12-06T21:13:13.001ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8832024-12-06T21:13:13.001ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8842024-12-06T21:13:13.033ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8852024-12-06T21:13:13.033ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8862024-12-06T21:13:13.066ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8872024-12-06T21:13:13.066ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8882024-12-06T21:13:13.099ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 539a083e-1490-43d7-a48e-aa74e2071476, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
8892024-12-06T21:13:13.099ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 539a083e-1490-43d7-a48e-aa74e2071476, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8902024-12-06T21:13:13.132ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8912024-12-06T21:13:13.132ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
8922024-12-06T21:13:13.132ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
8932024-12-06T21:13:13.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8942024-12-06T21:13:13.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8952024-12-06T21:13:13.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8962024-12-06T21:13:13.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8972024-12-06T21:13:13.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8982024-12-06T21:13:13.216ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
8992024-12-06T21:13:13.308ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9 file = illumos-utils/src/zone.rs:325
9002024-12-06T21:13:13.312ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3 file = illumos-utils/src/zone.rs:325
9012024-12-06T21:13:13.316ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77 file = illumos-utils/src/zone.rs:325
9022024-12-06T21:13:13.321ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53 file = illumos-utils/src/zone.rs:325
9032024-12-06T21:13:13.325ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 file = illumos-utils/src/zone.rs:325
9042024-12-06T21:13:13.330ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9 file = illumos-utils/src/zone.rs:363
9052024-12-06T21:13:13.335ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3 file = illumos-utils/src/zone.rs:363
9062024-12-06T21:13:13.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77 file = illumos-utils/src/zone.rs:363
9072024-12-06T21:13:13.343ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53 file = illumos-utils/src/zone.rs:363
9082024-12-06T21:13:13.348ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 file = illumos-utils/src/zone.rs:363
9092024-12-06T21:13:16.274ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='78ffc5bb-418e-4a88-85d5-6ca47e3d59c9'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9102024-12-06T21:13:16.274ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9112024-12-06T21:13:16.329ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ba262f1b-9a53-4bb0-a20a-24ef72d3aa77'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9122024-12-06T21:13:16.329ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9132024-12-06T21:13:16.358ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c5d43251-a96e-40bd-b2ca-b2eaddbacd53'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9142024-12-06T21:13:16.358ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='69216fee-5ff3-4838-a0b2-0ff24b2798e3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9152024-12-06T21:13:16.358ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9162024-12-06T21:13:16.364ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9172024-12-06T21:13:16.373ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='539a083e-1490-43d7-a48e-aa74e2071476'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9182024-12-06T21:13:16.374ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9192024-12-06T21:13:16.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 48.800132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9202024-12-06T21:13:16.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 41.662363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9212024-12-06T21:13:16.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 130.487679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9222024-12-06T21:13:16.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 29.85039ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9232024-12-06T21:13:16.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 93.989497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9242024-12-06T21:13:16.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 61.493979ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9252024-12-06T21:13:16.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 149.485085ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9262024-12-06T21:13:17.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 66.597213ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9272024-12-06T21:13:17.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 252.794219ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9282024-12-06T21:13:17.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 57.218479ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9292024-12-06T21:13:17.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 106.502613ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9302024-12-06T21:13:17.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 259.498081ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9312024-12-06T21:13:17.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 118.5256ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9322024-12-06T21:13:17.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 382.242609ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9332024-12-06T21:13:18.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 258.553452ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9342024-12-06T21:13:18.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 458.720288ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9352024-12-06T21:13:18.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 203.15467ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9362024-12-06T21:13:18.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 288.55447ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9372024-12-06T21:13:19.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.171016976s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9382024-12-06T21:13:19.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 497.625721ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9392024-12-06T21:13:19.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.001096238s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9402024-12-06T21:13:19.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 580.825951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9412024-12-06T21:13:19.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 571.554539ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9422024-12-06T21:13:19.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 827.970947ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9432024-12-06T21:13:20.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 695.634135ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9442024-12-06T21:13:20.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 942.139544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9452024-12-06T21:13:20.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.112217889s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9462024-12-06T21:13:20.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.411631218s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9472024-12-06T21:13:20.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 745.217121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9482024-12-06T21:13:20.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 1.329324807s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9492024-12-06T21:13:20.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 625.116241ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9502024-12-06T21:13:21.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 926.967225ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9512024-12-06T21:13:21.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.190606621s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9522024-12-06T21:13:21.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 1.003569125s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9532024-12-06T21:13:21.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.193689502s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9542024-12-06T21:13:22.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 1.279300836s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9552024-12-06T21:13:22.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 896.372109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9562024-12-06T21:13:22.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 900.250715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9572024-12-06T21:13:22.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.207494124s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9582024-12-06T21:13:23.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 528.892222ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9592024-12-06T21:13:23.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 1.423965664s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9602024-12-06T21:13:23.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 641.562608ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9612024-12-06T21:13:23.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 1.193038927s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9622024-12-06T21:13:23.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.414995068s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9632024-12-06T21:13:23.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 738.296038ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9642024-12-06T21:13:24.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 1.004098085s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9652024-12-06T21:13:24.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 520.778735ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9662024-12-06T21:13:24.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 664.078167ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9672024-12-06T21:13:24.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 794.3956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9682024-12-06T21:13:25.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 1.068472972s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9692024-12-06T21:13:25.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.420859537s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9702024-12-06T21:13:25.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.191051765s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9712024-12-06T21:13:25.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 656.875162ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9722024-12-06T21:13:25.463ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 416.584692ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
9732024-12-06T21:13:25.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 686.847529ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9742024-12-06T21:13:26.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 941.779097ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9752024-12-06T21:13:26.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 819.8856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9762024-12-06T21:13:26.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 1.112457735s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9772024-12-06T21:13:26.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.092161834s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9782024-12-06T21:13:26.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.207802388s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9792024-12-06T21:13:26.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 520.26908ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9802024-12-06T21:13:27.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 1.277923917s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9812024-12-06T21:13:27.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53") failed: Property not found. retry in 1.084051664s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9822024-12-06T21:13:27.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 730.280641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9832024-12-06T21:13:27.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77") failed: Property not found. retry in 1.487346939s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9842024-12-06T21:13:27.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9") failed: Property not found. retry in 1.300322402s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9852024-12-06T21:13:28.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3") failed: Property not found. retry in 1.439563121s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9862024-12-06T21:13:28.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476") failed: Property not found. retry in 1.127600926s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9872024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_78ffc5bb-418e-4a88-85d5-6ca47e3d59c9
9882024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_69216fee-5ff3-4838-a0b2-0ff24b2798e3
9892024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ba262f1b-9a53-4bb0-a20a-24ef72d3aa77
9902024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_c5d43251-a96e-40bd-b2ca-b2eaddbacd53
9912024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476
9922024-12-06T21:13:29.694ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9932024-12-06T21:13:29.695ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9942024-12-06T21:13:29.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16784439 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54823 req_id = 5514e8e7-789b-4a30-a9b8-6192f5454de8 response_code = 204 uri = /omicron-zones
9952024-12-06T21:13:29.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36753
9962024-12-06T21:13:29.758ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 30211 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 91ccf4a1-7b36-422b-9643-16c2fdfa7850 response_code = 500 uri = /cockroachdb
9972024-12-06T21:13:29.758ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "91ccf4a1-7b36-422b-9643-16c2fdfa7850", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "91ccf4a1-7b36-422b-9643-16c2fdfa7850" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 55.239954ms
9982024-12-06T21:13:29.840ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 0b0d9136-c2d6-44e9-8dd3-066a4268e391 response_code = 500 uri = /cockroachdb
9992024-12-06T21:13:29.840ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0b0d9136-c2d6-44e9-8dd3-066a4268e391", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0b0d9136-c2d6-44e9-8dd3-066a4268e391" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 61.380627ms
10002024-12-06T21:13:29.929ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26646 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 369f90e8-2ad8-4573-9c8f-1cd437e111ee response_code = 500 uri = /cockroachdb
10012024-12-06T21:13:29.929ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "369f90e8-2ad8-4573-9c8f-1cd437e111ee", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "369f90e8-2ad8-4573-9c8f-1cd437e111ee" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 173.93199ms
10022024-12-06T21:13:30.131ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 37b3817d-8ea8-42b0-83d9-ff078771c9de response_code = 500 uri = /cockroachdb
10032024-12-06T21:13:30.131ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "37b3817d-8ea8-42b0-83d9-ff078771c9de", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:29 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "37b3817d-8ea8-42b0-83d9-ff078771c9de" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 115.611896ms
10042024-12-06T21:13:30.275ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 8b9b3af7-af9c-4ef2-bba6-bc3b7cf25f69 response_code = 500 uri = /cockroachdb
10052024-12-06T21:13:30.275ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b9b3af7-af9c-4ef2-bba6-bc3b7cf25f69", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b9b3af7-af9c-4ef2-bba6-bc3b7cf25f69" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 135.822747ms
10062024-12-06T21:13:30.438ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 8747c81a-575c-4bde-a9b2-309137ae2730 response_code = 500 uri = /cockroachdb
10072024-12-06T21:13:30.439ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8747c81a-575c-4bde-a9b2-309137ae2730", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8747c81a-575c-4bde-a9b2-309137ae2730" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 366.591813ms
10082024-12-06T21:13:30.833ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 270c102c-11b3-4e86-9038-83b20242aa13 response_code = 500 uri = /cockroachdb
10092024-12-06T21:13:30.833ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "270c102c-11b3-4e86-9038-83b20242aa13", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "270c102c-11b3-4e86-9038-83b20242aa13" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 296.084348ms
10102024-12-06T21:13:31.157ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 8777d6f9-d0c1-4395-b099-5c5870e13c60 response_code = 500 uri = /cockroachdb
10112024-12-06T21:13:31.158ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8777d6f9-d0c1-4395-b099-5c5870e13c60", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:30 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8777d6f9-d0c1-4395-b099-5c5870e13c60" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 475.902472ms
10122024-12-06T21:13:31.664ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService9/omicron6 in oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_539a083e-1490-43d7-a48e-aa74e2071476 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService9/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 29935 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 25491524-4d3e-442c-8b89-549e62808086 response_code = 500 uri = /cockroachdb
10132024-12-06T21:13:31.664ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "25491524-4d3e-442c-8b89-549e62808086", "content-length": "124", "date": "Fri, 06 Dec 2024 21:13:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "25491524-4d3e-442c-8b89-549e62808086" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 552.532263ms
10142024-12-06T21:13:32.252ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3743
10152024-12-06T21:13:48.207ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
10162024-12-06T21:14:01.081ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
10172024-12-06T21:14:01.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28866923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:36753 req_id = 7e56b85c-1fb5-47a6-b7c0-78faa4381f05 response_code = 204 uri = /cockroachdb
10182024-12-06T21:14:01.089ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 611.76065ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
10192024-12-06T21:14:01.121ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c (service), filesystem_pool: Some(ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: ab80bb76-7448-43ce-8e58-a6e11c319aab, kind: Service { id: 56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c }, name: Name("ntp-56af11cf-eb3a-4e8c-bbab-5dca5d45ae7c"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 103])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } } } }, OmicronZoneConfig { id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77 (service), filesystem_pool: Some(ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External } } } }, OmicronZoneConfig { id: 539a083e-1490-43d7-a48e-aa74e2071476 (service), filesystem_pool: Some(ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: a03854a6-7a78-402b-93b4-65c6d36bf236 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 709da000-e0da-4b29-8160-3112fd080927 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 0214b950-30f3-4a60-9344-b4f7d110e307 (service), filesystem_pool: Some(ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a211d4f7-7350-4466-97ca-36b58597b187 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 (service), filesystem_pool: Some(ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 9d509eff-9671-46fb-8274-6ec9019a9d9e (service), filesystem_pool: Some(ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 1599050b-778e-470a-9b66-21f00a6bf9ea (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 78dfb8b4-8077-4a5f-b7c8-201768c31ed4 (service), filesystem_pool: Some(ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 4d5631b7-c72e-4738-9d97-d1d9fff7a7c1 (service), filesystem_pool: Some(ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 9933dd1b-1035-4823-8d8c-826e928d0156 (service), filesystem_pool: Some(ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045 (service), filesystem_pool: Some(ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External } } } }, OmicronZoneConfig { id: 6f665690-70c9-400c-aad8-6a14b6acc016 (service), filesystem_pool: Some(ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External } } } }, OmicronZoneConfig { id: 04c9d75f-f538-4cf6-959e-fcc3cb7844c7 (service), filesystem_pool: Some(ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External } } } }, OmicronZoneConfig { id: a5b8d743-8020-458a-9473-652d99b0d371 (service), filesystem_pool: Some(ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf7ba581-9a36-4f68-b9f4-58e46f863380 (service), filesystem_pool: Some(ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External } } } }, OmicronZoneConfig { id: cfbfd364-b1fc-4538-b314-428f98007f50 (service), filesystem_pool: Some(ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External } } } }, OmicronZoneConfig { id: f97f2eed-ca8a-441e-82f0-d6a53e698319 (service), filesystem_pool: Some(ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85efa5dc-d3ff-49cd-a29f-ff61b60885be (service), filesystem_pool: Some(ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External } } } }, OmicronZoneConfig { id: 5a8cd359-b0a2-4a68-a36a-9a0544da0d41 (service), filesystem_pool: Some(ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10202024-12-06T21:14:01.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45569
10212024-12-06T21:14:01.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10222024-12-06T21:14:01.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4aff1ae3-2d71-40bf-bc46-79a7276da3c2, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10232024-12-06T21:14:01.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10242024-12-06T21:14:01.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 4dccdb26-9cf9-40aa-9229-5d35905cf0e1, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10252024-12-06T21:14:01.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10262024-12-06T21:14:01.234ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 79d475dc-44ec-44f4-9e51-ea8a753c39f3, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10272024-12-06T21:14:01.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10282024-12-06T21:14:01.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: c5d43251-a96e-40bd-b2ca-b2eaddbacd53, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10292024-12-06T21:14:01.345ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10302024-12-06T21:14:01.346ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 69216fee-5ff3-4838-a0b2-0ff24b2798e3, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10312024-12-06T21:14:01.398ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10322024-12-06T21:14:01.398ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 78ffc5bb-418e-4a88-85d5-6ca47e3d59c9, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10332024-12-06T21:14:01.461ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10342024-12-06T21:14:01.461ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ba262f1b-9a53-4bb0-a20a-24ef72d3aa77, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10352024-12-06T21:14:01.516ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 539a083e-1490-43d7-a48e-aa74e2071476, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10362024-12-06T21:14:01.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 539a083e-1490-43d7-a48e-aa74e2071476, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10372024-12-06T21:14:01.567ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a03854a6-7a78-402b-93b4-65c6d36bf236, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10382024-12-06T21:14:01.567ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a03854a6-7a78-402b-93b4-65c6d36bf236, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10392024-12-06T21:14:01.620ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 709da000-e0da-4b29-8160-3112fd080927, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10402024-12-06T21:14:01.620ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 709da000-e0da-4b29-8160-3112fd080927, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10412024-12-06T21:14:01.674ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1599050b-778e-470a-9b66-21f00a6bf9ea, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
10422024-12-06T21:14:01.674ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1599050b-778e-470a-9b66-21f00a6bf9ea, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10432024-12-06T21:14:01.727ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10442024-12-06T21:14:01.727ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045, dataset_name: DatasetName { pool_name: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, kind: Crucible }, responder: ... }
10452024-12-06T21:14:01.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6f665690-70c9-400c-aad8-6a14b6acc016, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10462024-12-06T21:14:01.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 6f665690-70c9-400c-aad8-6a14b6acc016, dataset_name: DatasetName { pool_name: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, kind: Crucible }, responder: ... }
10472024-12-06T21:14:01.835ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 04c9d75f-f538-4cf6-959e-fcc3cb7844c7, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10482024-12-06T21:14:01.835ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 04c9d75f-f538-4cf6-959e-fcc3cb7844c7, dataset_name: DatasetName { pool_name: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, kind: Crucible }, responder: ... }
10492024-12-06T21:14:01.883ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a5b8d743-8020-458a-9473-652d99b0d371, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10502024-12-06T21:14:01.883ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: a5b8d743-8020-458a-9473-652d99b0d371, dataset_name: DatasetName { pool_name: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, kind: Crucible }, responder: ... }
10512024-12-06T21:14:01.931ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cf7ba581-9a36-4f68-b9f4-58e46f863380, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10522024-12-06T21:14:01.931ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cf7ba581-9a36-4f68-b9f4-58e46f863380, dataset_name: DatasetName { pool_name: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, kind: Crucible }, responder: ... }
10532024-12-06T21:14:01.984ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cfbfd364-b1fc-4538-b314-428f98007f50, dataset_name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10542024-12-06T21:14:01.984ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cfbfd364-b1fc-4538-b314-428f98007f50, dataset_name: DatasetName { pool_name: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, kind: Crucible }, responder: ... }
10552024-12-06T21:14:02.050ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f97f2eed-ca8a-441e-82f0-d6a53e698319, dataset_name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10562024-12-06T21:14:02.050ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: f97f2eed-ca8a-441e-82f0-d6a53e698319, dataset_name: DatasetName { pool_name: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, kind: Crucible }, responder: ... }
10572024-12-06T21:14:02.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 85efa5dc-d3ff-49cd-a29f-ff61b60885be, dataset_name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10582024-12-06T21:14:02.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 85efa5dc-d3ff-49cd-a29f-ff61b60885be, dataset_name: DatasetName { pool_name: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, kind: Crucible }, responder: ... }
10592024-12-06T21:14:02.180ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5a8cd359-b0a2-4a68-a36a-9a0544da0d41, dataset_name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
10602024-12-06T21:14:02.180ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5a8cd359-b0a2-4a68-a36a-9a0544da0d41, dataset_name: DatasetName { pool_name: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, kind: Crucible }, responder: ... }
10612024-12-06T21:14:02.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10622024-12-06T21:14:02.231ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
10632024-12-06T21:14:02.231ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
10642024-12-06T21:14:02.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10652024-12-06T21:14:02.364ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10662024-12-06T21:14:02.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10672024-12-06T21:14:02.365ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10682024-12-06T21:14:02.380ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10692024-12-06T21:14:02.380ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10702024-12-06T21:14:02.380ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10712024-12-06T21:14:02.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10722024-12-06T21:14:02.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10732024-12-06T21:14:02.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10742024-12-06T21:14:02.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10752024-12-06T21:14:02.588ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10762024-12-06T21:14:02.589ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10772024-12-06T21:14:02.625ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10782024-12-06T21:14:02.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10792024-12-06T21:14:02.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10802024-12-06T21:14:02.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10812024-12-06T21:14:02.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10822024-12-06T21:14:02.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10832024-12-06T21:14:02.660ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10842024-12-06T21:14:02.660ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e file = illumos-utils/src/zone.rs:325
10852024-12-06T21:14:02.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea file = illumos-utils/src/zone.rs:325
10862024-12-06T21:14:02.672ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156 file = illumos-utils/src/zone.rs:325
10872024-12-06T21:14:02.678ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4 file = illumos-utils/src/zone.rs:325
10882024-12-06T21:14:02.684ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371 file = illumos-utils/src/zone.rs:325
10892024-12-06T21:14:02.690ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380 file = illumos-utils/src/zone.rs:325
10902024-12-06T21:14:02.695ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319 file = illumos-utils/src/zone.rs:325
10912024-12-06T21:14:02.700ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41 file = illumos-utils/src/zone.rs:325
10922024-12-06T21:14:02.825ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e file = illumos-utils/src/zone.rs:363
10932024-12-06T21:14:02.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea file = illumos-utils/src/zone.rs:363
10942024-12-06T21:14:02.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156 file = illumos-utils/src/zone.rs:363
10952024-12-06T21:14:02.840ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4 file = illumos-utils/src/zone.rs:363
10962024-12-06T21:14:02.845ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371 file = illumos-utils/src/zone.rs:363
10972024-12-06T21:14:02.850ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380 file = illumos-utils/src/zone.rs:363
10982024-12-06T21:14:02.855ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319 file = illumos-utils/src/zone.rs:363
10992024-12-06T21:14:02.861ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41 file = illumos-utils/src/zone.rs:363
11002024-12-06T21:14:02.867ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1 file = illumos-utils/src/zone.rs:325
11012024-12-06T21:14:02.872ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016 file = illumos-utils/src/zone.rs:325
11022024-12-06T21:14:02.877ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7 file = illumos-utils/src/zone.rs:325
11032024-12-06T21:14:02.882ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50 file = illumos-utils/src/zone.rs:325
11042024-12-06T21:14:02.889ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be file = illumos-utils/src/zone.rs:325
11052024-12-06T21:14:02.894ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045 file = illumos-utils/src/zone.rs:325
11062024-12-06T21:14:02.953ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11072024-12-06T21:14:03.012ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11082024-12-06T21:14:03.012ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1 file = illumos-utils/src/zone.rs:363
11092024-12-06T21:14:03.027ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016 file = illumos-utils/src/zone.rs:363
11102024-12-06T21:14:03.037ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7 file = illumos-utils/src/zone.rs:363
11112024-12-06T21:14:03.045ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50 file = illumos-utils/src/zone.rs:363
11122024-12-06T21:14:03.053ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be file = illumos-utils/src/zone.rs:363
11132024-12-06T21:14:03.059ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045 file = illumos-utils/src/zone.rs:363
11142024-12-06T21:14:03.121ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11152024-12-06T21:14:03.175ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11162024-12-06T21:14:03.178ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11172024-12-06T21:14:03.178ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11182024-12-06T21:14:03.233ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 245, 172]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11192024-12-06T21:14:03.233ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11202024-12-06T21:14:03.236ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11212024-12-06T21:14:03.236ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11222024-12-06T21:14:03.347ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 150, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11232024-12-06T21:14:03.347ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11242024-12-06T21:14:03.405ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11252024-12-06T21:14:03.407ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11262024-12-06T21:14:03.407ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11272024-12-06T21:14:03.460ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 160, 53]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11282024-12-06T21:14:03.460ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
11292024-12-06T21:14:03.460ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11302024-12-06T21:14:03.460ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11312024-12-06T21:14:03.460ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11322024-12-06T21:14:03.460ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11332024-12-06T21:14:03.462ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11342024-12-06T21:14:03.462ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11352024-12-06T21:14:03.518ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 172, 92]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11362024-12-06T21:14:03.518ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11372024-12-06T21:14:03.519ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11382024-12-06T21:14:03.519ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11392024-12-06T21:14:03.579ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 181, 41]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11402024-12-06T21:14:03.579ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
11412024-12-06T21:14:03.579ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11422024-12-06T21:14:03.581ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11432024-12-06T21:14:03.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11442024-12-06T21:14:03.583ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11452024-12-06T21:14:03.713ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11462024-12-06T21:14:03.713ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11472024-12-06T21:14:03.714ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5 file = illumos-utils/src/zone.rs:325
11482024-12-06T21:14:03.731ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11492024-12-06T21:14:03.731ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11502024-12-06T21:14:03.732ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11512024-12-06T21:14:03.732ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11522024-12-06T21:14:03.734ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11532024-12-06T21:14:03.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11542024-12-06T21:14:03.739ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236 file = illumos-utils/src/zone.rs:325
11552024-12-06T21:14:03.757ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11562024-12-06T21:14:03.762ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11572024-12-06T21:14:03.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11582024-12-06T21:14:03.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
11592024-12-06T21:14:03.819ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5 file = illumos-utils/src/zone.rs:363
11602024-12-06T21:14:03.830ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236 file = illumos-utils/src/zone.rs:363
11612024-12-06T21:14:03.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927 file = illumos-utils/src/zone.rs:325
11622024-12-06T21:14:03.956ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307 file = illumos-utils/src/zone.rs:325
11632024-12-06T21:14:03.972ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187 file = illumos-utils/src/zone.rs:325
11642024-12-06T21:14:03.999ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927 file = illumos-utils/src/zone.rs:363
11652024-12-06T21:14:04.033ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307 file = illumos-utils/src/zone.rs:363
11662024-12-06T21:14:04.043ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187 file = illumos-utils/src/zone.rs:363
11672024-12-06T21:14:13.668ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-12-06T21:14:13.686ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
11692024-12-06T21:14:13.726ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='a36ce176-1630-4724-9dec-806c4ec5fe81'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11702024-12-06T21:14:13.726ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c5430cc8-489c-438a-b730-df567e7b3e13/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c9e266c2-881c-4c23-b0d3-e9aa8ceb771a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-12-06T21:14:13.726ZINFOSledAgent (ServiceManager): Booting oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
11722024-12-06T21:14:13.734ZINFOSledAgent (ServiceManager): Booting oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
11732024-12-06T21:14:13.741ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1cb341c5-34e8-451b-86cd-f466ef64d711/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e2c69d62-2aae-4085-b6fc-643eed8092be'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11742024-12-06T21:14:13.742ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5a4431d9-0bda-44b3-8897-18e701a06931'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11752024-12-06T21:14:13.742ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_56416138-2c59-4897-b953-6407738ebcfc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d7134d74-d00f-4ac9-b4ea-3d469ae3ebd1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11762024-12-06T21:14:13.742ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
11772024-12-06T21:14:13.749ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
11782024-12-06T21:14:13.756ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
11792024-12-06T21:14:14.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 64.216965ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
11802024-12-06T21:14:14.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 41.238693ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
11812024-12-06T21:14:14.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 65.920993ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
11822024-12-06T21:14:14.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 51.561985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
11832024-12-06T21:14:14.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 46.610935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
11842024-12-06T21:14:14.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 45.044059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
11852024-12-06T21:14:14.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 123.347977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
11862024-12-06T21:14:14.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 78.748236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
11872024-12-06T21:14:14.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 65.580873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
11882024-12-06T21:14:14.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 66.061553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
11892024-12-06T21:14:14.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 129.5102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
11902024-12-06T21:14:14.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 132.869108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
11912024-12-06T21:14:14.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 123.947008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
11922024-12-06T21:14:14.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 273.864881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
11932024-12-06T21:14:14.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 244.993949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
11942024-12-06T21:14:14.232ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='9d509eff-9671-46fb-8274-6ec9019a9d9e'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-12-06T21:14:14.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 258.39469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
11962024-12-06T21:14:14.242ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
11972024-12-06T21:14:14.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 183.332904ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
11982024-12-06T21:14:14.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 181.658857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
11992024-12-06T21:14:14.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 547.174536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12002024-12-06T21:14:14.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 73.759288ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12012024-12-06T21:14:14.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 524.736426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
12022024-12-06T21:14:14.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 546.270807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
12032024-12-06T21:14:14.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 505.299542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
12042024-12-06T21:14:14.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 427.082667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12052024-12-06T21:14:14.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 214.822941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
12062024-12-06T21:14:14.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 82.761393ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12072024-12-06T21:14:14.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 292.320247ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12082024-12-06T21:14:14.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.10440331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
12092024-12-06T21:14:14.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 730.997409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12102024-12-06T21:14:14.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 282.083599ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12112024-12-06T21:14:14.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 440.831214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12122024-12-06T21:14:15.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 453.334105ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
12132024-12-06T21:14:15.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 747.848751ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
12142024-12-06T21:14:15.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 843.983452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
12152024-12-06T21:14:15.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 650.427541ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12162024-12-06T21:14:15.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.254722408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12172024-12-06T21:14:15.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.081949543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
12182024-12-06T21:14:15.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.216708911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12192024-12-06T21:14:16.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 924.075036ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
12202024-12-06T21:14:16.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 753.077041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
12212024-12-06T21:14:16.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.245720574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
12222024-12-06T21:14:16.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.330308663s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12232024-12-06T21:14:16.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.383576928s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
12242024-12-06T21:14:16.744ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12252024-12-06T21:14:16.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 624.113328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12262024-12-06T21:14:16.762ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12272024-12-06T21:14:16.762ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12282024-12-06T21:14:16.799ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cde60193-2934-47cc-b26d-187799c93142'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12292024-12-06T21:14:16.799ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12302024-12-06T21:14:16.807ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='838b8ac4-11dc-4f3d-8a42-f0760d3eeb3a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312024-12-06T21:14:16.808ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='20b20abf-ee0e-4c0e-9517-6e7733482ae6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12322024-12-06T21:14:16.808ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='661fd2ae-cafc-432b-8693-0a02886dd069'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-12-06T21:14:16.809ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12342024-12-06T21:14:16.817ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12352024-12-06T21:14:16.837ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.069039049s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
12362024-12-06T21:14:16.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 875.761138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
12372024-12-06T21:14:16.838ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12382024-12-06T21:14:16.846ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12392024-12-06T21:14:16.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 509.043037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12402024-12-06T21:14:16.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.008821786s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
12412024-12-06T21:14:17.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 45.572791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12422024-12-06T21:14:17.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 56.331032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12432024-12-06T21:14:17.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 26.156035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12442024-12-06T21:14:17.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 137.950313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12452024-12-06T21:14:17.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 68.754902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12462024-12-06T21:14:17.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 67.18926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12472024-12-06T21:14:17.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 126.197918ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12482024-12-06T21:14:17.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 72.908449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12492024-12-06T21:14:17.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 54.437074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12502024-12-06T21:14:17.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 92.176566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12512024-12-06T21:14:17.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 117.219907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12522024-12-06T21:14:17.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 107.902145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12532024-12-06T21:14:17.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 106.612219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12542024-12-06T21:14:17.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 137.710769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12552024-12-06T21:14:17.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 192.336769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12562024-12-06T21:14:17.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 157.998692ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12572024-12-06T21:14:17.290ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582024-12-06T21:14:17.290ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12592024-12-06T21:14:17.298ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12602024-12-06T21:14:17.298ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12612024-12-06T21:14:17.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 248.695951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12622024-12-06T21:14:17.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 515.25231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12632024-12-06T21:14:17.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 252.285117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12642024-12-06T21:14:17.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 749.237448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
12652024-12-06T21:14:17.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 525.256593ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12662024-12-06T21:14:17.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.269111993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12672024-12-06T21:14:17.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 755.460575ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12682024-12-06T21:14:17.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 418.357891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12692024-12-06T21:14:17.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 440.94241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12702024-12-06T21:14:17.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 807.684762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12712024-12-06T21:14:17.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 68.214714ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12722024-12-06T21:14:17.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 28.948795ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12732024-12-06T21:14:17.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 402.18567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12742024-12-06T21:14:17.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.166495393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
12752024-12-06T21:14:17.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 115.750165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12762024-12-06T21:14:17.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 253.77374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12772024-12-06T21:14:17.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 60.092209ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12782024-12-06T21:14:17.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 499.364479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12792024-12-06T21:14:17.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 262.69905ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12802024-12-06T21:14:17.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 884.413959ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
12812024-12-06T21:14:17.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 177.828411ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12822024-12-06T21:14:17.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 918.809202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
12832024-12-06T21:14:17.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 834.568234ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12842024-12-06T21:14:17.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.329833934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
12852024-12-06T21:14:18.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 701.144344ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12862024-12-06T21:14:18.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 431.301707ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12872024-12-06T21:14:18.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.475856596s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
12882024-12-06T21:14:18.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 664.458392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
12892024-12-06T21:14:18.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 432.624315ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12902024-12-06T21:14:18.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 601.362761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
12912024-12-06T21:14:18.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 961.993558ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
12922024-12-06T21:14:18.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 738.957205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
12932024-12-06T21:14:18.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.399353297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
12942024-12-06T21:14:18.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 727.312216ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
12952024-12-06T21:14:18.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.053383419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
12962024-12-06T21:14:18.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 903.99012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
12972024-12-06T21:14:18.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 911.043421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
12982024-12-06T21:14:18.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.091510615s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
12992024-12-06T21:14:18.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 974.173143ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
13002024-12-06T21:14:18.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.006074026s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13012024-12-06T21:14:18.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 873.272043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
13022024-12-06T21:14:18.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 947.705796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
13032024-12-06T21:14:18.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 593.324747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
13042024-12-06T21:14:19.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 816.143991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
13052024-12-06T21:14:19.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 768.346237ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13062024-12-06T21:14:19.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 946.213065ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
13072024-12-06T21:14:19.295ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13082024-12-06T21:14:19.295ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092024-12-06T21:14:19.295ZINFOSledAgent (ServiceManager): Booting oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13102024-12-06T21:14:19.303ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13112024-12-06T21:14:19.311ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-12-06T21:14:19.311ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13132024-12-06T21:14:19.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.410532333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
13142024-12-06T21:14:19.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 42.515041ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13152024-12-06T21:14:19.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 27.863213ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13162024-12-06T21:14:19.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 73.136901ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13172024-12-06T21:14:19.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.240424239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
13182024-12-06T21:14:19.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.407556246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
13192024-12-06T21:14:19.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.038700544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
13202024-12-06T21:14:19.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 51.955455ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13212024-12-06T21:14:19.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 147.444273ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13222024-12-06T21:14:19.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 133.161381ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13232024-12-06T21:14:19.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 719.289614ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
13242024-12-06T21:14:19.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 236.25065ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13252024-12-06T21:14:19.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 795.224684ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
13262024-12-06T21:14:19.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.426541216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
13272024-12-06T21:14:19.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 984.846144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
13282024-12-06T21:14:19.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.088791336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
13292024-12-06T21:14:19.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 294.007945ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13302024-12-06T21:14:19.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 262.084487ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13312024-12-06T21:14:19.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 671.111706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
13322024-12-06T21:14:19.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.307718538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13332024-12-06T21:14:19.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.340256279s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
13342024-12-06T21:14:19.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.033788578s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
13352024-12-06T21:14:19.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 669.154412ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13362024-12-06T21:14:19.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 284.931205ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13372024-12-06T21:14:20.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 512.815649ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13382024-12-06T21:14:20.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 263.566752ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13392024-12-06T21:14:20.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.394304884s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
13402024-12-06T21:14:20.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 639.610409ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13412024-12-06T21:14:20.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 864.044548ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13422024-12-06T21:14:20.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 699.167617ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
13432024-12-06T21:14:20.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.134513855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
13442024-12-06T21:14:20.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.191979242s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
13452024-12-06T21:14:20.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.134245285s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13462024-12-06T21:14:20.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 788.701733ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13472024-12-06T21:14:20.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.021473274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
13482024-12-06T21:14:20.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 635.997758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
13492024-12-06T21:14:20.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 983.654336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
13502024-12-06T21:14:20.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 946.180406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
13512024-12-06T21:14:20.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.122682798s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
13522024-12-06T21:14:20.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.093300099s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13532024-12-06T21:14:20.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 871.224018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
13542024-12-06T21:14:21.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.090924971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
13552024-12-06T21:14:21.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.406541857s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
13562024-12-06T21:14:21.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 793.339961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13572024-12-06T21:14:21.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 642.409899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
13582024-12-06T21:14:21.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 998.25498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
13592024-12-06T21:14:21.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.124732819s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13602024-12-06T21:14:21.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 565.773033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
13612024-12-06T21:14:21.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.24153298s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13622024-12-06T21:14:21.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 685.94668ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
13632024-12-06T21:14:21.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.397466194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
13642024-12-06T21:14:21.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.33802292s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
13652024-12-06T21:14:21.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 586.013935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
13662024-12-06T21:14:21.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.40815643s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13672024-12-06T21:14:21.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.037907669s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
13682024-12-06T21:14:21.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.39159014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
13692024-12-06T21:14:21.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.25733842s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
13702024-12-06T21:14:21.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 902.915188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
13712024-12-06T21:14:21.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 540.021854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13722024-12-06T21:14:21.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 652.358921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
13732024-12-06T21:14:22.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 898.029903ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13742024-12-06T21:14:22.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 617.499486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
13752024-12-06T21:14:22.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 901.599249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
13762024-12-06T21:14:22.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.022584547s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
13772024-12-06T21:14:22.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.465996274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
13782024-12-06T21:14:22.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 908.548969ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
13792024-12-06T21:14:22.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.382283943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
13802024-12-06T21:14:22.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 644.47093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13812024-12-06T21:14:22.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 716.707159ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
13822024-12-06T21:14:22.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.490404095s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
13832024-12-06T21:14:22.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 672.305351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
13842024-12-06T21:14:22.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 577.532502ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13852024-12-06T21:14:22.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.156137089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
13862024-12-06T21:14:22.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 913.321506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
13872024-12-06T21:14:22.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.397622796s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
13882024-12-06T21:14:23.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.069898744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
13892024-12-06T21:14:23.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.203243339s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
13902024-12-06T21:14:23.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 924.717179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
13912024-12-06T21:14:23.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.260367553s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
13922024-12-06T21:14:23.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 750.379836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
13932024-12-06T21:14:23.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 515.523115ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
13942024-12-06T21:14:23.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.193216229s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
13952024-12-06T21:14:23.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.479072653s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
13962024-12-06T21:14:23.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.141650437s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
13972024-12-06T21:14:23.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 954.111362ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
13982024-12-06T21:14:23.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.026817905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
13992024-12-06T21:14:23.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 945.757156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14002024-12-06T21:14:23.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 629.842085ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14012024-12-06T21:14:23.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.255306132s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14022024-12-06T21:14:23.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 536.971618ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14032024-12-06T21:14:23.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.348428091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14042024-12-06T21:14:23.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 776.970471ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14052024-12-06T21:14:23.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.36014631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
14062024-12-06T21:14:24.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 855.355037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
14072024-12-06T21:14:24.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.296517966s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
14082024-12-06T21:14:24.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 998.641255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
14092024-12-06T21:14:24.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.302279558s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14102024-12-06T21:14:24.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.190227103s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
14112024-12-06T21:14:24.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 920.337648ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14122024-12-06T21:14:24.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 707.936875ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
14132024-12-06T21:14:24.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.322544554s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14142024-12-06T21:14:24.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 798.636036ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14152024-12-06T21:14:24.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 907.635838ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14162024-12-06T21:14:24.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 999.898806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
14172024-12-06T21:14:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.106028205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
14182024-12-06T21:14:24.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.094961415s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14192024-12-06T21:14:24.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 571.612798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14202024-12-06T21:14:24.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 718.589471ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
14212024-12-06T21:14:24.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.34968883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
14222024-12-06T21:14:25.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 939.417705ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14232024-12-06T21:14:25.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.11166583s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
14242024-12-06T21:14:25.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 987.54311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
14252024-12-06T21:14:25.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.248218149s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14262024-12-06T21:14:25.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 521.433345ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14272024-12-06T21:14:25.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 597.215034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14282024-12-06T21:14:25.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.072832492s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14292024-12-06T21:14:25.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 941.928425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14302024-12-06T21:14:25.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.387016749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
14312024-12-06T21:14:25.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 898.171675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
14322024-12-06T21:14:25.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 783.642629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
14332024-12-06T21:14:25.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 528.111272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
14342024-12-06T21:14:25.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.338745502s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
14352024-12-06T21:14:25.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.436984206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
14362024-12-06T21:14:25.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.022053345s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14372024-12-06T21:14:25.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 980.971475ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14382024-12-06T21:14:25.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 680.351781ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14392024-12-06T21:14:25.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 934.813691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14402024-12-06T21:14:25.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.445254947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14412024-12-06T21:14:25.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 830.893938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14422024-12-06T21:14:26.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.070842431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
14432024-12-06T21:14:26.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.121300846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
14442024-12-06T21:14:26.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.053665388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
14452024-12-06T21:14:26.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 854.610006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
14462024-12-06T21:14:26.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.238250389s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
14472024-12-06T21:14:26.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 684.004351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14482024-12-06T21:14:26.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.274201528s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
14492024-12-06T21:14:26.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.38586202s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14502024-12-06T21:14:26.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 910.916667ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14512024-12-06T21:14:26.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.196826411s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14522024-12-06T21:14:26.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 682.166647ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14532024-12-06T21:14:26.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 850.693425ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14542024-12-06T21:14:26.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 863.752475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14552024-12-06T21:14:26.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 985.192412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
14562024-12-06T21:14:26.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.270399295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14572024-12-06T21:14:26.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.267280792s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
14582024-12-06T21:14:26.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 804.621483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14592024-12-06T21:14:26.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 915.509303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
14602024-12-06T21:14:27.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 909.542589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
14612024-12-06T21:14:27.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.366418736s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
14622024-12-06T21:14:27.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.428428446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
14632024-12-06T21:14:27.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.211038685s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14642024-12-06T21:14:27.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.399189326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
14652024-12-06T21:14:27.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 857.421927ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14662024-12-06T21:14:27.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 952.253934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14672024-12-06T21:14:27.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 837.793197ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14682024-12-06T21:14:27.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.163856816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
14692024-12-06T21:14:27.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 881.000607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14702024-12-06T21:14:27.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.223485281s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
14712024-12-06T21:14:27.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 984.058713ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14722024-12-06T21:14:27.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.29062182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
14732024-12-06T21:14:27.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 966.288834ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14742024-12-06T21:14:27.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.014553575s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14752024-12-06T21:14:27.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 699.564408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
14762024-12-06T21:14:28.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.361108501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
14772024-12-06T21:14:28.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 540.488246ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14782024-12-06T21:14:28.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 785.690147ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
14792024-12-06T21:14:28.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 795.670453ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14802024-12-06T21:14:28.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.246848454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
14812024-12-06T21:14:28.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 637.584817ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14822024-12-06T21:14:28.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 868.374116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
14832024-12-06T21:14:28.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 683.491204ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14842024-12-06T21:14:28.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.230882573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
14852024-12-06T21:14:28.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.173422681s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
14862024-12-06T21:14:28.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 711.570336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
14872024-12-06T21:14:28.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 769.3617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
14882024-12-06T21:14:28.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 856.796854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
14892024-12-06T21:14:28.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 955.694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
14902024-12-06T21:14:28.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 762.841961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
14912024-12-06T21:14:28.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 982.315044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
14922024-12-06T21:14:28.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.066803758s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
14932024-12-06T21:14:28.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.338589391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
14942024-12-06T21:14:28.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.332838624s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
14952024-12-06T21:14:28.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.215162975s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
14962024-12-06T21:14:28.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.214567054s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
14972024-12-06T21:14:28.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 709.456685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
14982024-12-06T21:14:29.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 870.410096ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
14992024-12-06T21:14:29.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.212206397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15002024-12-06T21:14:29.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.104033959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
15012024-12-06T21:14:29.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.4068253s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
15022024-12-06T21:14:29.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.010708173s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
15032024-12-06T21:14:29.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.363233143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
15042024-12-06T21:14:29.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.268475974s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
15052024-12-06T21:14:29.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 796.058338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
15062024-12-06T21:14:29.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 794.061957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
15072024-12-06T21:14:29.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 700.371032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
15082024-12-06T21:14:29.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 584.477381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15092024-12-06T21:14:29.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.264651188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
15102024-12-06T21:14:29.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.269409447s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
15112024-12-06T21:14:29.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 575.865374ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
15122024-12-06T21:14:29.882ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15132024-12-06T21:14:29.882ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15142024-12-06T21:14:30.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 800.634516ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
15152024-12-06T21:14:30.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 32.756609ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15162024-12-06T21:14:30.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.365627259s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
15172024-12-06T21:14:30.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 102.928636ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15182024-12-06T21:14:30.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.174849048s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
15192024-12-06T21:14:30.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.281921926s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
15202024-12-06T21:14:30.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 810.389352ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
15212024-12-06T21:14:30.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 103.83737ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15222024-12-06T21:14:30.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.487591948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15232024-12-06T21:14:30.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.385167301s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
15242024-12-06T21:14:30.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 409.708639ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15252024-12-06T21:14:30.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.132367259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
15262024-12-06T21:14:30.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.397804782s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
15272024-12-06T21:14:30.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.381421707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
15282024-12-06T21:14:30.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.257439998s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
15292024-12-06T21:14:30.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.448259326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
15302024-12-06T21:14:30.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 560.089171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15312024-12-06T21:14:30.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.228223856s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
15322024-12-06T21:14:30.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.409558488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
15332024-12-06T21:14:30.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.435239765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
15342024-12-06T21:14:30.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 730.714241ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15352024-12-06T21:14:30.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 850.510117ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
15362024-12-06T21:14:31.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.011864079s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
15372024-12-06T21:14:31.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 567.39104ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15382024-12-06T21:14:31.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 521.510371ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
15392024-12-06T21:14:31.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 728.223573ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
15402024-12-06T21:14:31.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 531.822669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
15412024-12-06T21:14:31.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 842.913765ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
15422024-12-06T21:14:31.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 976.127254ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
15432024-12-06T21:14:31.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 777.01888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
15442024-12-06T21:14:31.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.318669047s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15452024-12-06T21:14:31.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.499698647s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
15462024-12-06T21:14:31.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 661.776217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15472024-12-06T21:14:31.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.336676224s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
15482024-12-06T21:14:31.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 879.288737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
15492024-12-06T21:14:31.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.392296032s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
15502024-12-06T21:14:31.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 721.639206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15512024-12-06T21:14:31.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.337085797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
15522024-12-06T21:14:31.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.290799328s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
15532024-12-06T21:14:31.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 656.405654ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
15542024-12-06T21:14:31.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 699.809433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
15552024-12-06T21:14:31.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 780.2619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
15562024-12-06T21:14:32.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 768.903781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
15572024-12-06T21:14:32.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 688.066977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
15582024-12-06T21:14:32.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.3648742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
15592024-12-06T21:14:32.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 964.351339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
15602024-12-06T21:14:32.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.351515864s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
15612024-12-06T21:14:32.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.369761159s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15622024-12-06T21:14:32.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 853.00674ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
15632024-12-06T21:14:32.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 589.387144ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
15642024-12-06T21:14:32.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.009364331s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
15652024-12-06T21:14:32.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 572.867122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15662024-12-06T21:14:32.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 721.125109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
15672024-12-06T21:14:32.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.259334516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
15682024-12-06T21:14:32.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.051736018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
15692024-12-06T21:14:32.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 778.787668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
15702024-12-06T21:14:32.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 956.7136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
15712024-12-06T21:14:32.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 820.5035ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15722024-12-06T21:14:33.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 694.119863ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
15732024-12-06T21:14:33.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 950.64964ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
15742024-12-06T21:14:33.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.330174943s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
15752024-12-06T21:14:33.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.081862526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15762024-12-06T21:14:33.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 667.237595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
15772024-12-06T21:14:33.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.017909712s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
15782024-12-06T21:14:33.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.068913778s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
15792024-12-06T21:14:33.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.029662202s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
15802024-12-06T21:14:33.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 649.31068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
15812024-12-06T21:14:33.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.439405497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
15822024-12-06T21:14:33.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.119055521s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
15832024-12-06T21:14:33.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 976.499014ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
15842024-12-06T21:14:33.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 515.049432ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
15852024-12-06T21:14:33.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.467230361s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
15862024-12-06T21:14:33.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 684.263368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
15872024-12-06T21:14:33.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 892.198787ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
15882024-12-06T21:14:33.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 752.505869ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
15892024-12-06T21:14:33.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 911.486038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
15902024-12-06T21:14:33.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 589.645317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
15912024-12-06T21:14:33.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 762.353139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
15922024-12-06T21:14:33.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 823.034128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
15932024-12-06T21:14:33.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.169933549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
15942024-12-06T21:14:33.959ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.940710919s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
15952024-12-06T21:14:34.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 841.878349ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
15962024-12-06T21:14:34.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.084326065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
15972024-12-06T21:14:34.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 630.737881ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
15982024-12-06T21:14:34.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 580.120473ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
15992024-12-06T21:14:34.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.156895969s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
16002024-12-06T21:14:34.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 974.448656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
16012024-12-06T21:14:34.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 628.276855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
16022024-12-06T21:14:34.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.171656367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
16032024-12-06T21:14:34.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 581.164777ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
16042024-12-06T21:14:34.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 744.284529ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
16052024-12-06T21:14:34.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.1162468s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
16062024-12-06T21:14:34.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 1.363546382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
16072024-12-06T21:14:34.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.08757593s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16082024-12-06T21:14:34.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 865.784136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
16092024-12-06T21:14:34.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 754.103017ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
16102024-12-06T21:14:34.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 1.486343633s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
16112024-12-06T21:14:34.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.007573814s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
16122024-12-06T21:14:34.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 837.231543ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
16132024-12-06T21:14:34.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 1.421082492s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
16142024-12-06T21:14:34.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.100869273s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
16152024-12-06T21:14:35.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 1.119860899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
16162024-12-06T21:14:35.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.143904989s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
16172024-12-06T21:14:35.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156") failed: Property not found. retry in 1.479551479s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
16182024-12-06T21:14:35.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 849.00935ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
16192024-12-06T21:14:35.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 997.173932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
16202024-12-06T21:14:35.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 1.120356947s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
16212024-12-06T21:14:35.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4") failed: Property not found. retry in 1.300450902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
16222024-12-06T21:14:35.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 729.375338ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
16232024-12-06T21:14:35.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 654.34655ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
16242024-12-06T21:14:35.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 1.317006828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
16252024-12-06T21:14:35.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 1.475795318s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
16262024-12-06T21:14:35.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 562.393521ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
16272024-12-06T21:14:35.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.318395387s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
16282024-12-06T21:14:35.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 908.487117ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16292024-12-06T21:14:35.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371") failed: Property not found. retry in 1.47044008s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
16302024-12-06T21:14:36.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 551.091442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
16312024-12-06T21:14:36.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.317292419s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
16322024-12-06T21:14:36.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 931.455692ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
16332024-12-06T21:14:36.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.01157295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
16342024-12-06T21:14:36.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be") failed: Property not found. retry in 799.457275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
16352024-12-06T21:14:36.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50") failed: Property not found. retry in 1.478938889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
16362024-12-06T21:14:36.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 755.617182ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
16372024-12-06T21:14:36.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319") failed: Property not found. retry in 1.45709424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
16382024-12-06T21:14:36.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1") failed: Property not found. retry in 925.94511ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
16392024-12-06T21:14:36.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016") failed: Property not found. retry in 1.103171366s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
16402024-12-06T21:14:36.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 519.324196ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
16412024-12-06T21:14:36.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e") failed: Property not found. retry in 944.412996ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
16422024-12-06T21:14:36.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7") failed: Property not found. retry in 837.19788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
16432024-12-06T21:14:36.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 616.624212ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16442024-12-06T21:14:36.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236") failed: Property not found. retry in 570.407574ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
16452024-12-06T21:14:36.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045") failed: Property not found. retry in 960.386175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
16462024-12-06T21:14:37.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.133960598s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
16472024-12-06T21:14:37.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5") failed: Property not found. retry in 1.44309088s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
16482024-12-06T21:14:37.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 988.051189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
16492024-12-06T21:14:37.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41") failed: Property not found. retry in 963.502894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
16502024-12-06T21:14:37.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380") failed: Property not found. retry in 1.292333549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
16512024-12-06T21:14:37.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.235014314s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16522024-12-06T21:14:37.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927") failed: Property not found. retry in 1.423820493s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
16532024-12-06T21:14:38.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187") failed: Property not found. retry in 1.102245996s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
16542024-12-06T21:14:38.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307") failed: Property not found. retry in 1.274938039s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
16552024-12-06T21:14:38.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 911.50885ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16562024-12-06T21:14:39.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.127965683s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16572024-12-06T21:14:40.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 544.417041ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16582024-12-06T21:14:41.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.018454042s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16592024-12-06T21:14:42.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea") failed: Property not found. retry in 1.226341018s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16602024-12-06T21:14:42.848ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53717
16612024-12-06T21:14:42.863ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10407 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53717 req_id = 21d3310c-044a-4089-949b-f854035296d6 response_code = 200 uri = /baseboard
16622024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_9d509eff-9671-46fb-8274-6ec9019a9d9e
16632024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_1599050b-778e-470a-9b66-21f00a6bf9ea
16642024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_e8725c8c-13ab-4916-bf16-bb7f832014d5
16652024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_9933dd1b-1035-4823-8d8c-826e928d0156
16662024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_78dfb8b4-8077-4a5f-b7c8-201768c31ed4
16672024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_a03854a6-7a78-402b-93b4-65c6d36bf236
16682024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_a5b8d743-8020-458a-9473-652d99b0d371
16692024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_cf7ba581-9a36-4f68-b9f4-58e46f863380
16702024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_f97f2eed-ca8a-441e-82f0-d6a53e698319
16712024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_5a8cd359-b0a2-4a68-a36a-9a0544da0d41
16722024-12-06T21:14:43.478ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_0214b950-30f3-4a60-9344-b4f7d110e307
16732024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_a211d4f7-7350-4466-97ca-36b58597b187
16742024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_4d5631b7-c72e-4738-9d97-d1d9fff7a7c1
16752024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_6f665690-70c9-400c-aad8-6a14b6acc016
16762024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_04c9d75f-f538-4cf6-959e-fcc3cb7844c7
16772024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_709da000-e0da-4b29-8160-3112fd080927
16782024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_cfbfd364-b1fc-4538-b314-428f98007f50
16792024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_85efa5dc-d3ff-49cd-a29f-ff61b60885be
16802024-12-06T21:14:43.479ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_aa4bfc7d-bb75-47cd-a0fd-8ac4598a1045
16812024-12-06T21:14:43.490ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16822024-12-06T21:14:43.502ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16832024-12-06T21:14:43.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42403743 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45569 req_id = c8514520-0ddb-44e0-9c78-cea6a3950d08 response_code = 204 uri = /omicron-zones
16842024-12-06T21:14:43.540ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16852024-12-06T21:14:44.071ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16862024-12-06T21:14:44.096ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
16872024-12-06T21:14:44.131ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
16882024-12-06T21:14:48.271ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 7.204233258s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
16892024-12-06T21:14:48.271ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16902024-12-06T21:14:48.328ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16912024-12-06T21:14:48.467ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16922024-12-06T21:14:48.603ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16932024-12-06T21:14:48.806ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16942024-12-06T21:14:49.023ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16952024-12-06T21:14:49.372ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16962024-12-06T21:14:49.544ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16972024-12-06T21:14:49.756ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16982024-12-06T21:14:50.372ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
16992024-12-06T21:14:50.875ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2d75e4a3-6363-4fd1-935e-989d31fd7d71/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17002024-12-06T21:14:52.792ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "bb7dd6ff-1c45-435d-892e-d104f1730d8c", "content-length": "173", "date": "Fri, 06 Dec 2024 21:14:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"2d75e4a3-6363-4fd1-935e-989d31fd7d71\"", request_id: "bb7dd6ff-1c45-435d-892e-d104f1730d8c" } file = sled-agent/src/rack_setup/service.rs:1078
17012024-12-06T21:14:53.963ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "88276442-fbc1-40d0-aa50-d39e19822931", "content-length": "173", "date": "Fri, 06 Dec 2024 21:14:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"2d75e4a3-6363-4fd1-935e-989d31fd7d71\"", request_id: "88276442-fbc1-40d0-aa50-d39e19822931" } file = sled-agent/src/rack_setup/service.rs:1078
17022024-12-06T21:14:56.140ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9dd6a121-4a84-4a64-9fee-5ddc715284e7", "content-length": "173", "date": "Fri, 06 Dec 2024 21:14:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cbc5c1c6-5668-455a-85ef-94f4aebe0f80\"", request_id: "9dd6a121-4a84-4a64-9fee-5ddc715284e7" } file = sled-agent/src/rack_setup/service.rs:1078
17032024-12-06T21:14:57.620ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cddbccb9-c7e9-47a8-bc4e-6000835f82c0", "content-length": "173", "date": "Fri, 06 Dec 2024 21:14:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cbc5c1c6-5668-455a-85ef-94f4aebe0f80\"", request_id: "cddbccb9-c7e9-47a8-bc4e-6000835f82c0" } file = sled-agent/src/rack_setup/service.rs:1078
17042024-12-06T21:14:59.386ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ef50480e-9dc2-4797-8e4b-796d2ccbfec7", "content-length": "173", "date": "Fri, 06 Dec 2024 21:14:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cbc5c1c6-5668-455a-85ef-94f4aebe0f80\"", request_id: "ef50480e-9dc2-4797-8e4b-796d2ccbfec7" } file = sled-agent/src/rack_setup/service.rs:1078
17052024-12-06T21:15:01.642ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "d144e00f-d61f-4eef-8dae-bed3e075f046", "content-length": "173", "date": "Fri, 06 Dec 2024 21:15:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cbc5c1c6-5668-455a-85ef-94f4aebe0f80\"", request_id: "d144e00f-d61f-4eef-8dae-bed3e075f046" } file = sled-agent/src/rack_setup/service.rs:1078
17062024-12-06T21:15:03.838ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7c480019-1790-4f35-aa0c-4d621cd19ae5", "content-length": "173", "date": "Fri, 06 Dec 2024 21:15:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"cbc5c1c6-5668-455a-85ef-94f4aebe0f80\"", request_id: "7c480019-1790-4f35-aa0c-4d621cd19ae5" } file = sled-agent/src/rack_setup/service.rs:1078
17072024-12-06T21:15:03.917ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
17082024-12-06T21:15:04.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60761
17092024-12-06T21:15:04.010ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17102024-12-06T21:15:04.010ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17112024-12-06T21:15:04.010ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
17122024-12-06T21:15:04.012ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
17132024-12-06T21:15:04.028ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17142024-12-06T21:15:04.028ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d
17152024-12-06T21:15:04.051ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17162024-12-06T21:15:04.051ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17
17172024-12-06T21:15:04.072ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17182024-12-06T21:15:04.072ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1
17192024-12-06T21:15:04.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17202024-12-06T21:15:04.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5430cc8-489c-438a-b730-df567e7b3e13
17212024-12-06T21:15:04.109ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17222024-12-06T21:15:04.109ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4
17232024-12-06T21:15:04.128ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17242024-12-06T21:15:04.128ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_56416138-2c59-4897-b953-6407738ebcfc
17252024-12-06T21:15:04.149ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17262024-12-06T21:15:04.149ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1cb341c5-34e8-451b-86cd-f466ef64d711
17272024-12-06T21:15:04.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17282024-12-06T21:15:04.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae
17292024-12-06T21:15:04.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17302024-12-06T21:15:04.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c
17312024-12-06T21:15:04.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60761 req_id = 606e8bfc-b188-4bad-8389-dd3af1177a57 response_code = 200 uri = /inventory
17322024-12-06T21:15:06.839ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:48012 remote_addr = [fd00:1122:3344:101::d]:59834 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
17332024-12-06T21:15:06.863ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22439 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = c48c2887-8581-4f03-99b6-28ce55645be0 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
17342024-12-06T21:15:07.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35789
17352024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17362024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17392024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17402024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17412024-12-06T21:15:07.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17422024-12-06T21:15:07.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10073 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35789 req_id = bc75526c-ec6e-433a-abb3-5171145acab5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17432024-12-06T21:15:07.349ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
17442024-12-06T21:15:07.353ZINFOSledAgent (RSS): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17452024-12-06T21:15:07.354ZINFOSledAgent (RSS): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17462024-12-06T21:15:07.559ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63417
17472024-12-06T21:15:07.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17482024-12-06T21:15:07.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
17492024-12-06T21:15:07.559ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
17502024-12-06T21:15:07.560ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
17512024-12-06T21:15:07.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17522024-12-06T21:15:07.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d
17532024-12-06T21:15:07.600ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17542024-12-06T21:15:07.600ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17
17552024-12-06T21:15:07.628ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17562024-12-06T21:15:07.628ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1
17572024-12-06T21:15:07.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63214
17582024-12-06T21:15:07.652ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17592024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17602024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17612024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17622024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17632024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17642024-12-06T21:15:07.653ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17652024-12-06T21:15:07.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 459 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63214 req_id = 6d938493-c8cd-4c0f-9b9b-2ccd4ddfd1e7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17662024-12-06T21:15:07.654ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17672024-12-06T21:15:07.654ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5430cc8-489c-438a-b730-df567e7b3e13
17682024-12-06T21:15:07.677ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17692024-12-06T21:15:07.677ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4
17702024-12-06T21:15:07.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17712024-12-06T21:15:07.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_56416138-2c59-4897-b953-6407738ebcfc
17722024-12-06T21:15:07.724ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17732024-12-06T21:15:07.724ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1cb341c5-34e8-451b-86cd-f466ef64d711
17742024-12-06T21:15:07.745ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17752024-12-06T21:15:07.745ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae
17762024-12-06T21:15:07.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56676
17772024-12-06T21:15:07.748ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17782024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17792024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17802024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17812024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17822024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17832024-12-06T21:15:07.749ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17842024-12-06T21:15:07.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 727 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56676 req_id = 446ad019-2b74-4624-8153-6cbb146d91f9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17852024-12-06T21:15:07.766ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
17862024-12-06T21:15:07.766ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c
17872024-12-06T21:15:07.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63417 req_id = f67234a8-fcfb-42e5-8fa4-80dec0ef1ca1 response_code = 200 uri = /inventory
17882024-12-06T21:15:08.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32781
17892024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17902024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17912024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17932024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17942024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17952024-12-06T21:15:08.537ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17962024-12-06T21:15:08.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32781 req_id = 330b22c1-0370-4eb8-9c43-3fbb0440de69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17972024-12-06T21:15:12.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55164
17982024-12-06T21:15:12.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55164 req_id = 7d01cca7-be93-4e20-a0ad-708a36673aed response_code = 200 uri = /vpc-routes
17992024-12-06T21:15:12.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18002024-12-06T21:15:12.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 936 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55164 req_id = a0b62605-db64-481f-b262-4fabc704ca57 response_code = 204 uri = /eip-gateways
18012024-12-06T21:15:12.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55164 req_id = 14e6bc64-b00e-48ec-b5ea-5f8d416ed286 response_code = 204 uri = /vpc-routes
18022024-12-06T21:15:12.900ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62537
18032024-12-06T21:15:12.906ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62537 req_id = aa6cd284-0721-4cc2-bd4e-64b138063ce2 response_code = 200 uri = /baseboard
18042024-12-06T21:15:23.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52362
18052024-12-06T21:15:23.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52362 req_id = 57fdbc57-3b98-4105-86eb-99c50b029f54 response_code = 200 uri = /vpc-routes
18062024-12-06T21:15:23.542ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18072024-12-06T21:15:23.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52362 req_id = 5e86a2ac-7437-472b-ba5a-f78923691c8f response_code = 204 uri = /eip-gateways
18082024-12-06T21:15:23.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52362 req_id = bc2a8413-34ce-4edf-a389-888ac7234b11 response_code = 204 uri = /vpc-routes
18092024-12-06T21:15:23.557ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64332
18102024-12-06T21:15:23.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5647 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64332 req_id = a7527672-d431-4e8e-9739-03c9cd4314b0 response_code = 200 uri = /v2p
18112024-12-06T21:15:23.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36105
18122024-12-06T21:15:23.727ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18132024-12-06T21:15:23.792ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18142024-12-06T21:15:23.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36105 req_id = d948df91-6d2e-4181-8c69-bfbe00e1f7c3 response_code = 204 uri = /switch-ports
18152024-12-06T21:15:23.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36105 req_id = 40897f8c-8933-4629-a96e-fb25bb544332 response_code = 200 uri = /network-bootstore-config
18162024-12-06T21:15:23.905ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18172024-12-06T21:15:23.905ZINFOSledAgent (bootstore): Writing ledger to /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18182024-12-06T21:15:23.907ZINFOSledAgent (bootstore): Writing ledger to /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18192024-12-06T21:15:23.907ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18202024-12-06T21:15:23.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4086 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36105 req_id = 454e91ee-c835-499b-ad56-31f17401f7b7 response_code = 204 uri = /network-bootstore-config
18212024-12-06T21:15:24.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52198
18222024-12-06T21:15:24.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52198 req_id = 9b33bedd-9aa2-4bc0-9d09-78171d4a7d67 response_code = 200 uri = /vpc-routes
18232024-12-06T21:15:24.658ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18242024-12-06T21:15:24.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52198 req_id = 6e31ff92-6a0e-411d-86f7-ab0cc463b44d response_code = 204 uri = /eip-gateways
18252024-12-06T21:15:24.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52198 req_id = a45f7a80-a3fa-496d-96b9-10de31f921e7 response_code = 204 uri = /vpc-routes
18262024-12-06T21:15:24.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47953
18272024-12-06T21:15:24.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47953 req_id = 082286b8-c2bc-4e08-ad26-9c8d7db09882 response_code = 200 uri = /vpc-routes
18282024-12-06T21:15:24.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48926
18292024-12-06T21:15:24.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48926 req_id = 595bc0fa-3457-4952-bb05-04275f6fc180 response_code = 200 uri = /v2p
18302024-12-06T21:15:24.791ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18312024-12-06T21:15:24.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47953 req_id = e8f7ed6f-f5ed-4802-9c94-43e76934fce4 response_code = 204 uri = /eip-gateways
18322024-12-06T21:15:24.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47953 req_id = e9efd183-01fc-41fd-b763-e02bac9dd085 response_code = 204 uri = /vpc-routes
18332024-12-06T21:15:24.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39677
18342024-12-06T21:15:24.860ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18352024-12-06T21:15:24.898ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18362024-12-06T21:15:24.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39677 req_id = 63ebbaf9-dac9-46d5-a881-284a52e8f141 response_code = 204 uri = /switch-ports
18372024-12-06T21:15:24.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37329
18382024-12-06T21:15:24.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37329 req_id = 03978ef2-e7b3-4b49-b164-8f0f703e4ceb response_code = 200 uri = /v2p
18392024-12-06T21:15:24.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39677 req_id = 2b37d938-a8bd-4d25-b1bb-36fe3d9dcfd2 response_code = 200 uri = /network-bootstore-config
18402024-12-06T21:15:25.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56714
18412024-12-06T21:15:25.033ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18422024-12-06T21:15:25.071ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18432024-12-06T21:15:25.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56714 req_id = 879e00d5-09e5-4f6e-b96e-7a8ac76e5cc7 response_code = 204 uri = /switch-ports
18442024-12-06T21:15:25.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56714 req_id = 88b214ff-8009-48b2-884d-637b63f0feda response_code = 200 uri = /network-bootstore-config
18452024-12-06T21:15:36.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7185 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = a4a75672-83d2-427f-b765-4acc2e4486d4 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
18462024-12-06T21:15:42.958ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35665
18472024-12-06T21:15:42.959ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35665 req_id = 13918503-b6df-40f0-9bf1-5d92b12a50cb response_code = 200 uri = /baseboard
18482024-12-06T21:15:53.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51802
18492024-12-06T21:15:53.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51802 req_id = 362a40f2-f247-4d4b-aa87-c129ee0f9954 response_code = 200 uri = /vpc-routes
18502024-12-06T21:15:53.538ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18512024-12-06T21:15:53.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51802 req_id = b99b21fd-9f5b-4c29-8565-370f9ab9ddaf response_code = 204 uri = /eip-gateways
18522024-12-06T21:15:53.552ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51802 req_id = fd8f375a-deb1-4819-86a3-b8a45230c352 response_code = 204 uri = /vpc-routes
18532024-12-06T21:15:53.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46053
18542024-12-06T21:15:53.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46053 req_id = 9e969072-4e27-45f8-b442-436965e600a1 response_code = 200 uri = /v2p
18552024-12-06T21:15:53.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51136
18562024-12-06T21:15:53.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18572024-12-06T21:15:53.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18582024-12-06T21:15:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51136 req_id = 7c51cc26-98d1-41e4-b817-d32be829c902 response_code = 204 uri = /switch-ports
18592024-12-06T21:15:54.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51136 req_id = 5866da9a-0cac-48a2-9d02-907045081273 response_code = 200 uri = /network-bootstore-config
18602024-12-06T21:15:54.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33869
18612024-12-06T21:15:54.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33869 req_id = 83d3b40d-4ebe-40bb-870f-83a2fed57d37 response_code = 200 uri = /vpc-routes
18622024-12-06T21:15:54.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64220
18632024-12-06T21:15:54.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64220 req_id = b72541e5-7d79-4a44-a694-065d6f7829d4 response_code = 200 uri = /vpc-routes
18642024-12-06T21:15:54.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18652024-12-06T21:15:54.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64220 req_id = bdb95427-4f13-4e91-9ed6-55c0a828a6da response_code = 204 uri = /eip-gateways
18662024-12-06T21:15:54.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49022
18672024-12-06T21:15:54.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49022 req_id = 7a7471d6-b0ef-497a-8688-5eead7b5d645 response_code = 200 uri = /v2p
18682024-12-06T21:15:54.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64220 req_id = 18ecb655-59d2-40c7-8d93-cb612a979b36 response_code = 204 uri = /vpc-routes
18692024-12-06T21:15:54.883ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18702024-12-06T21:15:54.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33869 req_id = c191a7d7-6467-4614-b27d-db1957343818 response_code = 204 uri = /eip-gateways
18712024-12-06T21:15:54.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33869 req_id = 4275d849-fc7e-4db8-a3fe-79f3f5769c47 response_code = 204 uri = /vpc-routes
18722024-12-06T21:15:55.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43490
18732024-12-06T21:15:55.003ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18742024-12-06T21:15:55.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18752024-12-06T21:15:55.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101224 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43490 req_id = b01871fd-12a9-4dcf-ace7-b4b521dc8bf7 response_code = 204 uri = /switch-ports
18762024-12-06T21:15:55.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33325
18772024-12-06T21:15:55.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33325 req_id = 7e768388-920e-40b3-b07c-b107d71bb4e6 response_code = 200 uri = /v2p
18782024-12-06T21:15:55.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43490 req_id = 35e9cc5d-2ab0-4a62-a2c4-881f26957976 response_code = 200 uri = /network-bootstore-config
18792024-12-06T21:15:55.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46993
18802024-12-06T21:15:55.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18812024-12-06T21:15:55.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18822024-12-06T21:15:55.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46993 req_id = 14375215-8b4e-4728-8c69-1d38f70d38a4 response_code = 204 uri = /switch-ports
18832024-12-06T21:15:55.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46993 req_id = b2aa43e6-634c-4cc0-a1b3-11d738820025 response_code = 200 uri = /network-bootstore-config
18842024-12-06T21:16:06.557ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7107 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 4d3bdac5-90de-46db-a3c9-b88346d4086b response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
18852024-12-06T21:16:12.994ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37008
18862024-12-06T21:16:12.994ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37008 req_id = 056af7df-7fa5-419d-abe3-23ba8138e964 response_code = 200 uri = /baseboard
18872024-12-06T21:16:23.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52241
18882024-12-06T21:16:23.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52241 req_id = f96842f5-857e-40a7-bc11-4f9cab01cd01 response_code = 200 uri = /vpc-routes
18892024-12-06T21:16:23.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
18902024-12-06T21:16:23.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52241 req_id = 7e6645a4-0481-4960-b518-ef5f3c0c1e24 response_code = 204 uri = /eip-gateways
18912024-12-06T21:16:23.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52041
18922024-12-06T21:16:23.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52041 req_id = e4df93a5-84f6-4cb9-9846-99904eaa97ba response_code = 200 uri = /v2p
18932024-12-06T21:16:23.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52241 req_id = f375739a-43a6-47fd-be9c-e0eb88b0c5e9 response_code = 204 uri = /vpc-routes
18942024-12-06T21:16:23.708ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52327
18952024-12-06T21:16:23.708ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
18962024-12-06T21:16:23.744ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
18972024-12-06T21:16:23.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87553 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52327 req_id = 73d8c92e-48fe-4f01-943a-215ebd0ac683 response_code = 204 uri = /switch-ports
18982024-12-06T21:16:23.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52327 req_id = 794e1703-e88d-4ad7-85b7-dafa8919de7c response_code = 200 uri = /network-bootstore-config
18992024-12-06T21:16:24.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37666
19002024-12-06T21:16:24.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37666 req_id = 564b0f13-882d-484a-bfc7-37dd542b378d response_code = 200 uri = /vpc-routes
19012024-12-06T21:16:24.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19022024-12-06T21:16:24.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37666 req_id = 73feee5a-39f3-4788-b1d6-c5686b37b899 response_code = 204 uri = /eip-gateways
19032024-12-06T21:16:24.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41086
19042024-12-06T21:16:24.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41086 req_id = 95067963-149f-4be3-9df5-317ecdb292e2 response_code = 200 uri = /vpc-routes
19052024-12-06T21:16:24.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37666 req_id = 92a1c117-0253-4969-b76e-3ee4fdb54d45 response_code = 204 uri = /vpc-routes
19062024-12-06T21:16:24.805ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19072024-12-06T21:16:24.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41086 req_id = 3ad9e9d2-a729-45fc-86cf-e776dadb3766 response_code = 204 uri = /eip-gateways
19082024-12-06T21:16:24.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41086 req_id = 5898cf24-e661-4501-87a9-72c746b888a3 response_code = 204 uri = /vpc-routes
19092024-12-06T21:16:24.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58275
19102024-12-06T21:16:24.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58275 req_id = e5a60b50-1c95-4f66-9b92-e9b82b73f00a response_code = 200 uri = /v2p
19112024-12-06T21:16:24.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64968
19122024-12-06T21:16:24.905ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19132024-12-06T21:16:24.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19142024-12-06T21:16:25.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102160 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64968 req_id = 694bf8e5-46ff-4054-a5c9-9dd0970e140c response_code = 204 uri = /switch-ports
19152024-12-06T21:16:25.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45459
19162024-12-06T21:16:25.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56591
19172024-12-06T21:16:25.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56591 req_id = 17c7e072-1698-4961-a7d4-8f70227c753e response_code = 200 uri = /v2p
19182024-12-06T21:16:25.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64968 req_id = 73bbaab1-fd6c-431a-9616-ac420e788125 response_code = 200 uri = /network-bootstore-config
19192024-12-06T21:16:25.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19202024-12-06T21:16:25.047ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19212024-12-06T21:16:25.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45459 req_id = 0e97e3c5-5fc1-4058-80b5-4cebe8969fdd response_code = 204 uri = /switch-ports
19222024-12-06T21:16:25.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45459 req_id = 016b6ca1-5400-40c4-a2f6-b5168e24bac4 response_code = 200 uri = /network-bootstore-config
19232024-12-06T21:16:36.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6846 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 42a779a4-8339-41e4-9667-cf47e85ce3a3 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
19242024-12-06T21:16:43.026ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40201
19252024-12-06T21:16:43.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40201 req_id = a7472727-e962-4097-b64e-451d7dfd7df1 response_code = 200 uri = /baseboard
19262024-12-06T21:16:53.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49470
19272024-12-06T21:16:53.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49470 req_id = 5a4e2cfe-784d-401b-8fcc-a04124f5e126 response_code = 200 uri = /vpc-routes
19282024-12-06T21:16:53.755ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19292024-12-06T21:16:53.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49470 req_id = 42dee8fb-4118-4723-bfb5-bcff326c0608 response_code = 204 uri = /eip-gateways
19302024-12-06T21:16:53.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51167
19312024-12-06T21:16:53.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51167 req_id = 04050b87-f7a5-40be-95f8-95a54c4e34f6 response_code = 200 uri = /v2p
19322024-12-06T21:16:53.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49470 req_id = fd71dd0d-dc72-42ec-8793-5d6078495d83 response_code = 204 uri = /vpc-routes
19332024-12-06T21:16:53.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48886
19342024-12-06T21:16:53.878ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19352024-12-06T21:16:53.914ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19362024-12-06T21:16:53.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88696 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48886 req_id = a8a4045a-66e5-44bb-94d7-bfc6b47ae473 response_code = 204 uri = /switch-ports
19372024-12-06T21:16:53.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48886 req_id = 30577884-a0a7-480f-8128-5c712f119e9b response_code = 200 uri = /network-bootstore-config
19382024-12-06T21:16:54.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60562
19392024-12-06T21:16:54.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60562 req_id = a7784543-0639-4a57-b177-773c16456436 response_code = 200 uri = /vpc-routes
19402024-12-06T21:16:54.813ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19412024-12-06T21:16:54.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60562 req_id = b90e2696-c9f5-4706-9ce6-a30a1203b583 response_code = 204 uri = /eip-gateways
19422024-12-06T21:16:54.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60562 req_id = 8e747b23-9a82-4fb7-b14b-f5c978672062 response_code = 204 uri = /vpc-routes
19432024-12-06T21:16:54.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56411
19442024-12-06T21:16:54.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56411 req_id = 4271b66e-7bba-4008-a555-54948b14dd32 response_code = 200 uri = /v2p
19452024-12-06T21:16:54.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62318
19462024-12-06T21:16:54.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19472024-12-06T21:16:54.970ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19482024-12-06T21:16:55.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62318 req_id = 0db3a4c6-a5b9-4caf-8853-ff33e0cd0331 response_code = 204 uri = /switch-ports
19492024-12-06T21:16:55.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41587
19502024-12-06T21:16:55.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62318 req_id = 8eb1d306-3458-41d9-a6d6-4b8b0771afe2 response_code = 200 uri = /network-bootstore-config
19512024-12-06T21:16:55.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41587 req_id = 58f8134a-3b93-4a91-b532-3dc8e5dbfd06 response_code = 200 uri = /vpc-routes
19522024-12-06T21:16:55.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59345
19532024-12-06T21:16:55.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59345 req_id = ef065853-59ef-41b0-b140-4bc257fb4438 response_code = 200 uri = /v2p
19542024-12-06T21:16:55.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19552024-12-06T21:16:55.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41587 req_id = 2f4bd8ca-2447-4853-9518-073fabe72e97 response_code = 204 uri = /eip-gateways
19562024-12-06T21:16:55.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41587 req_id = c7abe478-19d4-4582-a07b-3c97aa498d01 response_code = 204 uri = /vpc-routes
19572024-12-06T21:16:55.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52038
19582024-12-06T21:16:55.339ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19592024-12-06T21:16:55.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19602024-12-06T21:16:55.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89831 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52038 req_id = 29c771b2-7074-4d0b-9573-e7363a4077aa response_code = 204 uri = /switch-ports
19612024-12-06T21:16:55.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52038 req_id = e67a6540-a924-4a87-9333-a4bdf5f53634 response_code = 200 uri = /network-bootstore-config
19622024-12-06T21:17:06.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7284 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = f26efffd-1dc6-47fd-b998-7456805ef460 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
19632024-12-06T21:17:13.061ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52604
19642024-12-06T21:17:13.061ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52604 req_id = 60f08dad-014a-40c8-9d21-3c4e87ceb06d response_code = 200 uri = /baseboard
19652024-12-06T21:17:23.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34001
19662024-12-06T21:17:23.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34001 req_id = 7665c72f-b234-4b88-95ea-ebeddd13e556 response_code = 200 uri = /v2p
19672024-12-06T21:17:23.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50446
19682024-12-06T21:17:23.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50446 req_id = ca1285a8-4019-4846-aa35-e43524e7506d response_code = 200 uri = /vpc-routes
19692024-12-06T21:17:23.691ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19702024-12-06T21:17:23.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50446 req_id = 01a5920c-156c-4a63-a5bf-af8853686b1f response_code = 204 uri = /eip-gateways
19712024-12-06T21:17:23.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50446 req_id = d6185931-9d76-4c74-97fe-64f049de160d response_code = 204 uri = /vpc-routes
19722024-12-06T21:17:23.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64852
19732024-12-06T21:17:23.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19742024-12-06T21:17:23.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19752024-12-06T21:17:23.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96438 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64852 req_id = 36dbcff6-91f1-40a9-b09d-b798f2471db4 response_code = 204 uri = /switch-ports
19762024-12-06T21:17:23.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64852 req_id = 01fb2d2e-f15a-4113-86db-97e033ad6b8c response_code = 200 uri = /network-bootstore-config
19772024-12-06T21:17:24.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52056
19782024-12-06T21:17:24.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52056 req_id = 180f28c1-0151-476c-b59e-8cd2626bc8e8 response_code = 200 uri = /vpc-routes
19792024-12-06T21:17:24.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47242
19802024-12-06T21:17:24.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47242 req_id = 51dadb26-5d8a-4c54-bc46-4d608961b680 response_code = 200 uri = /vpc-routes
19812024-12-06T21:17:24.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44603
19822024-12-06T21:17:24.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44603 req_id = df08e0e8-f265-4ba6-9d29-46b11e8e68d8 response_code = 200 uri = /v2p
19832024-12-06T21:17:24.774ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19842024-12-06T21:17:24.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52056 req_id = 7b91d689-1930-43cc-8a09-385bfb606678 response_code = 204 uri = /eip-gateways
19852024-12-06T21:17:24.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
19862024-12-06T21:17:24.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47242 req_id = e3eee6b6-8296-4b3e-9164-b594b1de3369 response_code = 204 uri = /eip-gateways
19872024-12-06T21:17:24.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47242 req_id = 3fe3a347-210c-40a2-8532-c8df86a7659c response_code = 204 uri = /vpc-routes
19882024-12-06T21:17:24.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53147
19892024-12-06T21:17:24.803ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19902024-12-06T21:17:24.845ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19912024-12-06T21:17:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53147 req_id = 547ea9ba-e775-4de6-aa5b-dbf57d3f15eb response_code = 204 uri = /switch-ports
19922024-12-06T21:17:24.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33021
19932024-12-06T21:17:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 390 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52056 req_id = 1d948d72-f9e4-40f1-a126-b05c2c35eaee response_code = 204 uri = /vpc-routes
19942024-12-06T21:17:24.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53147 req_id = f0ab9b61-07c6-4b7a-bfc8-310a7e01a902 response_code = 200 uri = /network-bootstore-config
19952024-12-06T21:17:24.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33021 req_id = e7015f28-9185-4f4d-959a-aff818e0e499 response_code = 200 uri = /v2p
19962024-12-06T21:17:24.923ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51034
19972024-12-06T21:17:24.923ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
19982024-12-06T21:17:24.959ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
19992024-12-06T21:17:25.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51034 req_id = 5dba0a62-7d97-46ed-9611-84ef2a771727 response_code = 204 uri = /switch-ports
20002024-12-06T21:17:25.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51034 req_id = 960f76d8-bbeb-47dc-843e-df7baa50d8a2 response_code = 200 uri = /network-bootstore-config
20012024-12-06T21:17:29.972ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20022024-12-06T21:17:36.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7273 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = de1e6288-235d-4298-8652-eb430cb9fc77 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
20032024-12-06T21:17:43.092ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46660
20042024-12-06T21:17:43.092ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46660 req_id = e0f967eb-faf7-4714-8eb8-ae5e3003370e response_code = 200 uri = /baseboard
20052024-12-06T21:17:53.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54593
20062024-12-06T21:17:53.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54593 req_id = 2e4108ad-8f18-4907-91cf-2e83b40b6b6f response_code = 200 uri = /v2p
20072024-12-06T21:17:53.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57185
20082024-12-06T21:17:53.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57185 req_id = ba8305ae-480b-4808-a66b-db3ebcc208b0 response_code = 200 uri = /vpc-routes
20092024-12-06T21:17:53.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20102024-12-06T21:17:53.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57185 req_id = 55c372b0-bd50-4bed-947a-3fbc41684087 response_code = 204 uri = /eip-gateways
20112024-12-06T21:17:53.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57185 req_id = a40bbaa3-a413-42e1-b193-af7f33217f72 response_code = 204 uri = /vpc-routes
20122024-12-06T21:17:54.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64289
20132024-12-06T21:17:54.039ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20142024-12-06T21:17:54.076ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20152024-12-06T21:17:54.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88015 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64289 req_id = 03aae92a-5120-4e36-b1ae-cb5db4d083cb response_code = 204 uri = /switch-ports
20162024-12-06T21:17:54.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64289 req_id = 98cfc051-7892-40f1-8296-b20b2dfa16b0 response_code = 200 uri = /network-bootstore-config
20172024-12-06T21:17:54.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56356
20182024-12-06T21:17:54.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56356 req_id = 4796bb1d-16ab-4cbb-8ebd-55077f4d65d4 response_code = 200 uri = /vpc-routes
20192024-12-06T21:17:54.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20202024-12-06T21:17:54.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56356 req_id = 92f5f4b8-99f6-46c8-a43e-4da71f8991a7 response_code = 204 uri = /eip-gateways
20212024-12-06T21:17:54.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56356 req_id = f61e14a2-affb-4221-ae9e-d6844c0bbe31 response_code = 204 uri = /vpc-routes
20222024-12-06T21:17:54.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62240
20232024-12-06T21:17:54.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20242024-12-06T21:17:54.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20252024-12-06T21:17:55.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62240 req_id = ab564190-2895-4093-8f1b-5e187da34ad4 response_code = 204 uri = /switch-ports
20262024-12-06T21:17:55.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61139
20272024-12-06T21:17:55.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56969
20282024-12-06T21:17:55.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62240 req_id = f289f302-e5b6-4f4b-8244-c535d9ccd4a1 response_code = 200 uri = /network-bootstore-config
20292024-12-06T21:17:55.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61139 req_id = dc30d2fe-b536-4f3c-a807-1f4129139404 response_code = 200 uri = /vpc-routes
20302024-12-06T21:17:55.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56969 req_id = bce78aa6-17dd-4fc9-a668-4623e10dd17d response_code = 200 uri = /v2p
20312024-12-06T21:17:55.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49222
20322024-12-06T21:17:55.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49222 req_id = 84506c8e-c023-4fa2-bde3-077a31c7470c response_code = 200 uri = /v2p
20332024-12-06T21:17:55.052ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20342024-12-06T21:17:55.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61139 req_id = 9e0f1486-306b-484f-a332-6b555fbbfcca response_code = 204 uri = /eip-gateways
20352024-12-06T21:17:55.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52698
20362024-12-06T21:17:55.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20372024-12-06T21:17:55.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20382024-12-06T21:17:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93693 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52698 req_id = 8ff8aefa-6bb3-4ab7-b92b-f83448f297f7 response_code = 204 uri = /switch-ports
20392024-12-06T21:17:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52698 req_id = f7277d07-76be-499b-ad43-f86a39c4135e response_code = 200 uri = /network-bootstore-config
20402024-12-06T21:17:55.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61139 req_id = e808ba3a-d589-4410-bd23-cd7e3db12bd2 response_code = 204 uri = /vpc-routes
20412024-12-06T21:18:06.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6580 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = c20ef689-a676-4d99-bb14-dcde522e6c70 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
20422024-12-06T21:18:13.124ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65154
20432024-12-06T21:18:13.124ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65154 req_id = 83489f3a-f819-47b1-9175-932c550fa621 response_code = 200 uri = /baseboard
20442024-12-06T21:18:23.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39537
20452024-12-06T21:18:23.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39537 req_id = 20543add-6ad0-46ee-99bc-a5e6bbadec7b response_code = 200 uri = /vpc-routes
20462024-12-06T21:18:23.578ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20472024-12-06T21:18:23.578ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39537 req_id = 63f4885f-28c2-48d3-9789-b1917cb0797b response_code = 204 uri = /eip-gateways
20482024-12-06T21:18:23.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39537 req_id = 3963da9e-bb8f-4ac9-8f39-2d19db1270b3 response_code = 204 uri = /vpc-routes
20492024-12-06T21:18:23.626ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59152
20502024-12-06T21:18:23.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59152 req_id = 30912cf1-82a7-41c3-b948-106b47219085 response_code = 200 uri = /v2p
20512024-12-06T21:18:23.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44444
20522024-12-06T21:18:23.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20532024-12-06T21:18:23.668ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20542024-12-06T21:18:23.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44444 req_id = 0f075c58-b5df-45dd-ab18-f3a635061e9d response_code = 204 uri = /switch-ports
20552024-12-06T21:18:23.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44444 req_id = fabf79af-c92f-4fc1-8ea7-6160280ad1d8 response_code = 200 uri = /network-bootstore-config
20562024-12-06T21:18:24.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38109
20572024-12-06T21:18:24.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38109 req_id = 212c9223-ed28-4e38-9447-6a60a1f0236b response_code = 200 uri = /vpc-routes
20582024-12-06T21:18:24.608ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20592024-12-06T21:18:24.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38109 req_id = f2eee972-6c16-4951-b74c-caf9bfea7009 response_code = 204 uri = /eip-gateways
20602024-12-06T21:18:24.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38109 req_id = ed533598-9670-4f38-95b7-a6cae92cd168 response_code = 204 uri = /vpc-routes
20612024-12-06T21:18:24.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37691
20622024-12-06T21:18:24.696ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20632024-12-06T21:18:24.738ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20642024-12-06T21:18:24.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99885 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37691 req_id = fe435d5e-7fc0-4957-b2a1-a9b625024eff response_code = 204 uri = /switch-ports
20652024-12-06T21:18:24.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63272
20662024-12-06T21:18:24.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63272 req_id = 46678e36-dc73-43d6-9699-ef57a50b4436 response_code = 200 uri = /v2p
20672024-12-06T21:18:24.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37691 req_id = 44b89d6b-1421-45d0-838f-6a3a581dd52a response_code = 200 uri = /network-bootstore-config
20682024-12-06T21:18:24.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33326
20692024-12-06T21:18:24.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33326 req_id = 935474e7-527f-4dbd-8dd0-03a790d187a1 response_code = 200 uri = /vpc-routes
20702024-12-06T21:18:24.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20712024-12-06T21:18:24.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33326 req_id = b33a27b4-cf9e-44d0-87ee-3e088d049ffc response_code = 204 uri = /eip-gateways
20722024-12-06T21:18:24.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33326 req_id = becfe177-3f5e-4881-9cb8-22d2f5640571 response_code = 204 uri = /vpc-routes
20732024-12-06T21:18:24.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39278
20742024-12-06T21:18:24.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39278 req_id = d3408d8a-3d27-4793-b51f-dfd3672cf8e1 response_code = 200 uri = /v2p
20752024-12-06T21:18:24.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56282
20762024-12-06T21:18:24.988ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20772024-12-06T21:18:25.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20782024-12-06T21:18:25.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105246 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56282 req_id = 4ed50e40-df30-4b71-b525-6b2e1f1329b0 response_code = 204 uri = /switch-ports
20792024-12-06T21:18:25.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56282 req_id = 621f8d73-b246-4e6c-9308-2a8ac3d587cc response_code = 200 uri = /network-bootstore-config
20802024-12-06T21:18:36.557ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9796 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 5a7f398d-41c0-47b1-a063-f4908bf4e2a0 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
20812024-12-06T21:18:43.156ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44654
20822024-12-06T21:18:43.156ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44654 req_id = fa936204-d54a-4e56-9287-5e0ed751f591 response_code = 200 uri = /baseboard
20832024-12-06T21:18:53.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53417
20842024-12-06T21:18:53.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53417 req_id = 02acaa54-ea55-499b-83b3-a69508fbfcd0 response_code = 200 uri = /vpc-routes
20852024-12-06T21:18:53.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50020
20862024-12-06T21:18:53.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50020 req_id = 28fa4d51-fdba-4778-abe7-08d893c3f8f9 response_code = 200 uri = /v2p
20872024-12-06T21:18:53.753ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20882024-12-06T21:18:53.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53417 req_id = 7e380431-15e9-4f27-81b2-c3917b1a2b43 response_code = 204 uri = /eip-gateways
20892024-12-06T21:18:53.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53417 req_id = 32d73663-898a-4fb4-af8c-b9c685bf84c9 response_code = 204 uri = /vpc-routes
20902024-12-06T21:18:53.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39791
20912024-12-06T21:18:53.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20922024-12-06T21:18:53.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20932024-12-06T21:18:53.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39791 req_id = 138aee40-8838-400b-98a9-7ca4e24326e4 response_code = 204 uri = /switch-ports
20942024-12-06T21:18:53.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39791 req_id = d35a558d-e99d-4bbb-a8cc-d0ab68132464 response_code = 200 uri = /network-bootstore-config
20952024-12-06T21:18:54.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34479
20962024-12-06T21:18:54.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34479 req_id = 7f0dce52-d1e1-4811-9f8a-95865d383612 response_code = 200 uri = /vpc-routes
20972024-12-06T21:18:54.829ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
20982024-12-06T21:18:54.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34479 req_id = 4c4759d4-7c19-4961-b05f-35e0304ed9da response_code = 204 uri = /eip-gateways
20992024-12-06T21:18:54.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34479 req_id = 32d432a1-931b-4964-9482-dfcd1d69f4c7 response_code = 204 uri = /vpc-routes
21002024-12-06T21:18:54.854ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42642
21012024-12-06T21:18:54.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42642 req_id = cd9389d1-89b9-40ee-adce-3f2d33e72dee response_code = 200 uri = /v2p
21022024-12-06T21:18:54.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64632
21032024-12-06T21:18:54.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64632 req_id = 911013bd-c2f3-4ffe-b137-f9514ef56233 response_code = 200 uri = /vpc-routes
21042024-12-06T21:18:54.968ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21052024-12-06T21:18:54.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64632 req_id = 8d983ff9-1360-42e2-9c9c-d878dbcf9478 response_code = 204 uri = /eip-gateways
21062024-12-06T21:18:55.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60760
21072024-12-06T21:18:55.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60760 req_id = 34481d9c-3610-44aa-b628-d5757e1328db response_code = 200 uri = /v2p
21082024-12-06T21:18:55.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64632 req_id = 83489479-7d17-4e70-aec7-67ec9b4dcaa5 response_code = 204 uri = /vpc-routes
21092024-12-06T21:18:55.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43596
21102024-12-06T21:18:55.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21112024-12-06T21:18:55.089ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21122024-12-06T21:18:55.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43596 req_id = 34242d79-2145-43ce-a1d6-2defe9b50470 response_code = 204 uri = /switch-ports
21132024-12-06T21:18:55.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49774
21142024-12-06T21:18:55.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43596 req_id = 46a40c43-8a60-4437-9340-6271221ec918 response_code = 200 uri = /network-bootstore-config
21152024-12-06T21:18:55.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21162024-12-06T21:18:55.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21172024-12-06T21:18:55.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86591 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49774 req_id = 99a9ac43-0f71-4bbd-9e45-3b1fc648375d response_code = 204 uri = /switch-ports
21182024-12-06T21:18:55.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49774 req_id = 869d0092-fcae-4379-b65c-e511a88c3634 response_code = 200 uri = /network-bootstore-config
21192024-12-06T21:19:06.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7333 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 162251d9-59b0-41a4-9e58-d10c20ec7239 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
21202024-12-06T21:19:13.188ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46573
21212024-12-06T21:19:13.189ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46573 req_id = 21199765-b97c-4652-ab66-6b18eef1bd0f response_code = 200 uri = /baseboard
21222024-12-06T21:19:23.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40867
21232024-12-06T21:19:23.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40867 req_id = 6cefc690-a6cd-4a8b-8ce3-b34ea878f96e response_code = 200 uri = /vpc-routes
21242024-12-06T21:19:23.493ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21252024-12-06T21:19:23.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40867 req_id = 7ae7313e-e863-4191-9cf5-7aba2d6ce182 response_code = 204 uri = /eip-gateways
21262024-12-06T21:19:23.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40867 req_id = 0dae1a9d-ca41-4679-80be-bebd31de4f2e response_code = 204 uri = /vpc-routes
21272024-12-06T21:19:23.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47855
21282024-12-06T21:19:23.589ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21292024-12-06T21:19:23.627ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21302024-12-06T21:19:23.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95270 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47855 req_id = a28d2234-43d4-4f7d-be40-8e4bee4ce5c9 response_code = 204 uri = /switch-ports
21312024-12-06T21:19:23.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37702
21322024-12-06T21:19:23.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47855 req_id = 73eda1c0-47ee-4468-996e-e58ef9ed50f0 response_code = 200 uri = /network-bootstore-config
21332024-12-06T21:19:23.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37702 req_id = 77ea3edb-c147-4b11-a8dc-e98f1dab0920 response_code = 200 uri = /v2p
21342024-12-06T21:19:24.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56652
21352024-12-06T21:19:24.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56652 req_id = f6d372ae-d322-41c8-9f10-4c388c8f6221 response_code = 200 uri = /vpc-routes
21362024-12-06T21:19:24.560ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21372024-12-06T21:19:24.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56652 req_id = 1090d26b-a7d4-487e-8f29-e48f2c98d943 response_code = 204 uri = /eip-gateways
21382024-12-06T21:19:24.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56652 req_id = 88ae7746-6eb9-464f-963c-2f30b140b627 response_code = 204 uri = /vpc-routes
21392024-12-06T21:19:24.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40636
21402024-12-06T21:19:24.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40636 req_id = eede025a-9559-4ef6-8a27-218b8081537e response_code = 200 uri = /v2p
21412024-12-06T21:19:24.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38154
21422024-12-06T21:19:24.731ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21432024-12-06T21:19:24.770ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21442024-12-06T21:19:24.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38154 req_id = 003ef0f6-a7b1-4b5f-835d-80b06c4b7c9d response_code = 204 uri = /switch-ports
21452024-12-06T21:19:24.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57409
21462024-12-06T21:19:24.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57409 req_id = 274950db-92b7-4f92-8de2-2a653fbd7348 response_code = 200 uri = /vpc-routes
21472024-12-06T21:19:24.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38154 req_id = a6a3771f-23dc-4a84-b1ad-48425dc357d3 response_code = 200 uri = /network-bootstore-config
21482024-12-06T21:19:24.879ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21492024-12-06T21:19:24.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57409 req_id = 0b594c49-e2f8-49ad-9659-615d2185b8e9 response_code = 204 uri = /eip-gateways
21502024-12-06T21:19:24.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57409 req_id = 68bab8e8-ac00-44fb-b58d-2cfdd7edd787 response_code = 204 uri = /vpc-routes
21512024-12-06T21:19:24.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47706
21522024-12-06T21:19:24.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21532024-12-06T21:19:24.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21542024-12-06T21:19:25.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47706 req_id = 986060f5-e2bd-4540-9796-824a5e73c890 response_code = 204 uri = /switch-ports
21552024-12-06T21:19:25.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39570
21562024-12-06T21:19:25.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39570 req_id = 6c3fb6c4-a9e8-473d-86dc-bdee3641bacb response_code = 200 uri = /v2p
21572024-12-06T21:19:25.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47706 req_id = 724c4aae-a70c-4a76-9092-9940ef748d99 response_code = 200 uri = /network-bootstore-config
21582024-12-06T21:19:36.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6798 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 5898531d-69ff-453f-a21e-c25061bf7456 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
21592024-12-06T21:19:43.220ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51183
21602024-12-06T21:19:43.221ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51183 req_id = b177e318-db3e-4dee-bda6-22e9e0ea00ba response_code = 200 uri = /baseboard
21612024-12-06T21:19:53.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37198
21622024-12-06T21:19:53.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37198 req_id = a10b4d56-6fd0-47e5-b7d2-61a341fa53ee response_code = 200 uri = /vpc-routes
21632024-12-06T21:19:53.640ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21642024-12-06T21:19:53.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37198 req_id = 354b145a-ff00-48d1-bd82-997f3d2e8dc3 response_code = 204 uri = /eip-gateways
21652024-12-06T21:19:53.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46516
21662024-12-06T21:19:53.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46516 req_id = 099299b4-8964-480b-9fbd-e532e79e699d response_code = 200 uri = /v2p
21672024-12-06T21:19:53.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37198 req_id = 6f56434a-b6de-4670-bbd5-034f8bdeedc4 response_code = 204 uri = /vpc-routes
21682024-12-06T21:19:53.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51354
21692024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21702024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21712024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21722024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21732024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21742024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21752024-12-06T21:19:53.879ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21762024-12-06T21:19:53.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51354 req_id = f6c043ad-6fee-42ab-bf6a-43cadce8b43a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21772024-12-06T21:19:53.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52767
21782024-12-06T21:19:53.893ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21792024-12-06T21:19:53.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21802024-12-06T21:19:53.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52767 req_id = 941bc3bc-30f3-42c4-954a-a7e400477d1b response_code = 204 uri = /switch-ports
21812024-12-06T21:19:53.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52767 req_id = 274d6347-aaa2-4b3a-9598-1abf3bc71d19 response_code = 200 uri = /network-bootstore-config
21822024-12-06T21:19:54.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42770
21832024-12-06T21:19:54.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42770 req_id = b6365758-633c-43bb-9c18-338b3a73dd29 response_code = 200 uri = /vpc-routes
21842024-12-06T21:19:54.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
21852024-12-06T21:19:54.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42770 req_id = 051d8e8e-c366-4171-aa18-cdb12cf8d93c response_code = 204 uri = /eip-gateways
21862024-12-06T21:19:54.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64265
21872024-12-06T21:19:54.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64265 req_id = ced292df-8772-42cb-a994-b44ddbd59314 response_code = 200 uri = /v2p
21882024-12-06T21:19:54.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42770 req_id = fa6f937d-0d0f-401d-87a3-17626c4e1c03 response_code = 204 uri = /vpc-routes
21892024-12-06T21:19:54.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50464
21902024-12-06T21:19:54.881ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21912024-12-06T21:19:54.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21922024-12-06T21:19:54.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100738 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50464 req_id = 0f81a2dc-ca26-4dca-ba50-731e0d3dc16c response_code = 204 uri = /switch-ports
21932024-12-06T21:19:54.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50464 req_id = c383c72b-4cca-4b1d-973c-e9342bdcd37b response_code = 200 uri = /network-bootstore-config
21942024-12-06T21:19:54.993ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46499
21952024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21962024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21972024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21992024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22002024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22012024-12-06T21:19:54.993ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22022024-12-06T21:19:54.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 343 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46499 req_id = 6ec00280-00e8-4fe6-8be8-428ae373c430 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22032024-12-06T21:19:55.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62565
22042024-12-06T21:19:55.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62565 req_id = 0b7fef7d-e596-477f-9d0c-e42e8bfbf4d2 response_code = 200 uri = /vpc-routes
22052024-12-06T21:19:55.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22062024-12-06T21:19:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62565 req_id = 667db28e-0486-4858-b978-9c25772b817e response_code = 204 uri = /eip-gateways
22072024-12-06T21:19:55.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62565 req_id = 96d5701c-364a-47ce-acf7-ffa531bdc081 response_code = 204 uri = /vpc-routes
22082024-12-06T21:19:55.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55504
22092024-12-06T21:19:55.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55504 req_id = f4c9a475-9a61-48ac-8bc0-ee1338a0762b response_code = 200 uri = /v2p
22102024-12-06T21:19:55.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65209
22112024-12-06T21:19:55.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22122024-12-06T21:19:55.255ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22132024-12-06T21:19:55.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94888 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65209 req_id = ca314ff3-ab83-4c46-bd14-69410ed6a3d0 response_code = 204 uri = /switch-ports
22142024-12-06T21:19:55.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55917
22152024-12-06T21:19:55.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65209 req_id = 4dc5915c-bc48-47da-b61f-81c1b3c4bbb6 response_code = 200 uri = /network-bootstore-config
22162024-12-06T21:19:55.309ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22172024-12-06T21:19:55.309ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22182024-12-06T21:19:55.310ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22192024-12-06T21:19:55.310ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22202024-12-06T21:19:55.310ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22212024-12-06T21:19:55.310ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22222024-12-06T21:19:55.310ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22232024-12-06T21:19:55.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55917 req_id = d7f623b6-2163-481e-85b7-5760a2ac208a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22242024-12-06T21:20:06.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7619 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = f7fd2214-f599-4fc3-8637-f8651fddb0cc response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
22252024-12-06T21:20:13.255ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58777
22262024-12-06T21:20:13.255ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58777 req_id = ad65a0ab-0898-458b-930b-5745f4bf4757 response_code = 200 uri = /baseboard
22272024-12-06T21:20:23.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59748
22282024-12-06T21:20:23.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59748 req_id = 4eaa6b4e-aaf8-497c-91e6-f750e8095a3f response_code = 200 uri = /vpc-routes
22292024-12-06T21:20:23.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22302024-12-06T21:20:23.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59748 req_id = 3984b9e0-2006-4f44-ad8c-effacc7d31bb response_code = 204 uri = /eip-gateways
22312024-12-06T21:20:23.603ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57093
22322024-12-06T21:20:23.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57093 req_id = 420f1c14-13e4-4eb4-b686-0d2b34aba13b response_code = 200 uri = /v2p
22332024-12-06T21:20:23.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59748 req_id = 140d2f68-7b22-4e96-8c37-00cb5b575150 response_code = 204 uri = /vpc-routes
22342024-12-06T21:20:23.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50059
22352024-12-06T21:20:23.653ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22362024-12-06T21:20:23.690ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22372024-12-06T21:20:23.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50059 req_id = af8f5e88-d999-4ca5-82c4-ca69ccb692ac response_code = 204 uri = /switch-ports
22382024-12-06T21:20:23.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50059 req_id = 43bca991-a41f-415b-b5c9-5c042337b72a response_code = 200 uri = /network-bootstore-config
22392024-12-06T21:20:24.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40907
22402024-12-06T21:20:24.568ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40907 req_id = e588130f-3cf3-4558-a636-41edecd09088 response_code = 200 uri = /vpc-routes
22412024-12-06T21:20:24.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22422024-12-06T21:20:24.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40907 req_id = 207693a1-80c2-4850-bf66-12061161a025 response_code = 204 uri = /eip-gateways
22432024-12-06T21:20:24.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40907 req_id = 130dc7ea-72cb-4a43-9536-efe3a15ca2cb response_code = 204 uri = /vpc-routes
22442024-12-06T21:20:24.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63249
22452024-12-06T21:20:24.656ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22462024-12-06T21:20:24.703ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22472024-12-06T21:20:24.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63249 req_id = baccf568-1fed-49e1-baca-84eb5fddf36b response_code = 204 uri = /switch-ports
22482024-12-06T21:20:24.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41956
22492024-12-06T21:20:24.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41956 req_id = 79738857-f59e-4528-aa57-53cc05722d04 response_code = 200 uri = /v2p
22502024-12-06T21:20:24.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63249 req_id = abef7ab3-93a7-45a7-8dce-be7b72103e3b response_code = 200 uri = /network-bootstore-config
22512024-12-06T21:20:24.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37818
22522024-12-06T21:20:24.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37818 req_id = aa8b6d6a-9805-4105-a999-6ecca531d07c response_code = 200 uri = /vpc-routes
22532024-12-06T21:20:24.872ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22542024-12-06T21:20:24.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37818 req_id = 7c8861b6-16df-41d6-81a2-0a870980e9d7 response_code = 204 uri = /eip-gateways
22552024-12-06T21:20:24.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37818 req_id = 74d26299-1575-468f-be0b-9d28ad2a79ff response_code = 204 uri = /vpc-routes
22562024-12-06T21:20:24.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61798
22572024-12-06T21:20:24.964ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22582024-12-06T21:20:25.001ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22592024-12-06T21:20:25.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98811 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61798 req_id = aa8d49d7-7454-4aee-ba5c-7e45f34be4a6 response_code = 204 uri = /switch-ports
22602024-12-06T21:20:25.063ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57901
22612024-12-06T21:20:25.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57901 req_id = 85e08b3a-1443-4d2b-996f-440bd76126fe response_code = 200 uri = /v2p
22622024-12-06T21:20:25.063ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61798 req_id = 23494db8-ee87-4ce2-9ca8-7b4dac11cf67 response_code = 200 uri = /network-bootstore-config
22632024-12-06T21:20:36.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8137 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = f92afe29-fa13-44f9-945c-dbab214ea6fa response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
22642024-12-06T21:20:43.288ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52407
22652024-12-06T21:20:43.288ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52407 req_id = 1391510e-2852-497d-a271-a3cfcdc542fc response_code = 200 uri = /baseboard
22662024-12-06T21:20:53.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47179
22672024-12-06T21:20:53.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47179 req_id = 38df97ce-501b-4481-b43b-608c1e4234ec response_code = 200 uri = /vpc-routes
22682024-12-06T21:20:53.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61710
22692024-12-06T21:20:53.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61710 req_id = 9f28dfa7-b06d-4f69-9935-6347cbff3961 response_code = 200 uri = /v2p
22702024-12-06T21:20:53.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22712024-12-06T21:20:53.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47179 req_id = 37fda35b-ca9f-4154-9b1b-49327eac8d24 response_code = 204 uri = /eip-gateways
22722024-12-06T21:20:53.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47179 req_id = a190e9b4-748e-407b-b3c8-d679b26c0987 response_code = 204 uri = /vpc-routes
22732024-12-06T21:20:53.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62190
22742024-12-06T21:20:53.911ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22752024-12-06T21:20:53.948ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22762024-12-06T21:20:54.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93477 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62190 req_id = 11e255a0-d81a-495b-be84-6d5d0ef5581c response_code = 204 uri = /switch-ports
22772024-12-06T21:20:54.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62190 req_id = cedd5ed7-ff6f-4274-8903-ce33f4c46576 response_code = 200 uri = /network-bootstore-config
22782024-12-06T21:20:54.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59991
22792024-12-06T21:20:54.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59991 req_id = 0cb99c66-53f2-499a-b549-db79fe02a5cb response_code = 200 uri = /vpc-routes
22802024-12-06T21:20:54.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39477
22812024-12-06T21:20:54.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39477 req_id = ed42f2bd-81e3-4af9-a51c-efa1d208849f response_code = 200 uri = /v2p
22822024-12-06T21:20:54.802ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22832024-12-06T21:20:54.803ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59991 req_id = 6bb01c5e-9511-45a7-8c67-dcdc7734965d response_code = 204 uri = /eip-gateways
22842024-12-06T21:20:54.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59991 req_id = b984f8af-33b5-40b4-a336-5b6a14ec3057 response_code = 204 uri = /vpc-routes
22852024-12-06T21:20:54.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47942
22862024-12-06T21:20:54.918ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22872024-12-06T21:20:54.957ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22882024-12-06T21:20:55.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47942 req_id = f4d65e79-c9b9-4483-92b9-ce4b5c6fe68a response_code = 204 uri = /switch-ports
22892024-12-06T21:20:55.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47942 req_id = 251e5395-23be-4dd0-bdd9-8f6aacbb4ab4 response_code = 200 uri = /network-bootstore-config
22902024-12-06T21:20:55.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45163
22912024-12-06T21:20:55.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45163 req_id = 0d669fd2-853b-4842-9b17-91552eeafd1a response_code = 200 uri = /vpc-routes
22922024-12-06T21:20:55.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64291
22932024-12-06T21:20:55.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64291 req_id = d0b85c23-77c0-40da-9a28-5528455b0ffd response_code = 200 uri = /v2p
22942024-12-06T21:20:55.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
22952024-12-06T21:20:55.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45163 req_id = 55bd4beb-a072-44c7-a672-ab6b65a5cba1 response_code = 204 uri = /eip-gateways
22962024-12-06T21:20:55.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45163 req_id = 81fac6a7-1044-444c-a737-b50cbfae0cf4 response_code = 204 uri = /vpc-routes
22972024-12-06T21:20:55.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39370
22982024-12-06T21:20:55.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22992024-12-06T21:20:55.307ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23002024-12-06T21:20:55.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39370 req_id = e849deca-7572-448a-8578-26ec5aa63b86 response_code = 204 uri = /switch-ports
23012024-12-06T21:20:55.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39370 req_id = 7b327ba4-6e85-476f-aad7-8fb4b1926713 response_code = 200 uri = /network-bootstore-config
23022024-12-06T21:21:06.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8342 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 572c6d33-1092-41c5-9e77-4e6335d4efe9 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
23032024-12-06T21:21:13.323ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34852
23042024-12-06T21:21:13.323ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34852 req_id = f5d13e3b-1483-4d53-8b15-9ad001536ad4 response_code = 200 uri = /baseboard
23052024-12-06T21:21:23.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55899
23062024-12-06T21:21:23.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55899 req_id = 6d67704c-2ecb-47ce-a308-e0580a42bd33 response_code = 200 uri = /vpc-routes
23072024-12-06T21:21:23.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23082024-12-06T21:21:23.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55899 req_id = ceb33366-a35c-4043-926d-79bd47a5b2e8 response_code = 204 uri = /eip-gateways
23092024-12-06T21:21:23.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55899 req_id = 7eebd2e1-a8b1-4bde-bc23-e71237d77af2 response_code = 204 uri = /vpc-routes
23102024-12-06T21:21:23.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42233
23112024-12-06T21:21:23.644ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23122024-12-06T21:21:23.677ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23132024-12-06T21:21:23.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86154 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42233 req_id = 11cc33d1-9aad-45a5-a0bc-04459063b29a response_code = 204 uri = /switch-ports
23142024-12-06T21:21:23.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58817
23152024-12-06T21:21:23.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58817 req_id = 6361b0c1-0e7f-464b-9fff-bcf39b2da238 response_code = 200 uri = /v2p
23162024-12-06T21:21:23.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42233 req_id = 5717b3e9-8220-48b1-9c6d-dd9133e249ec response_code = 200 uri = /network-bootstore-config
23172024-12-06T21:21:24.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35508
23182024-12-06T21:21:24.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35508 req_id = 479f3a7a-d3ea-4cfd-885d-b2a94f2fbeec response_code = 200 uri = /vpc-routes
23192024-12-06T21:21:24.709ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23202024-12-06T21:21:24.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35508 req_id = ee5dd87f-de13-48e1-ace7-37b134480676 response_code = 204 uri = /eip-gateways
23212024-12-06T21:21:24.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35508 req_id = 4ebc94f0-495c-4e08-91ac-d53f180ddad7 response_code = 204 uri = /vpc-routes
23222024-12-06T21:21:24.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61637
23232024-12-06T21:21:24.771ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23242024-12-06T21:21:24.809ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23252024-12-06T21:21:24.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94148 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61637 req_id = 79f72e4a-8e0f-4b1e-bbf6-e27ea9619485 response_code = 204 uri = /switch-ports
23262024-12-06T21:21:24.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38476
23272024-12-06T21:21:24.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38476 req_id = 6101cbbf-6ac4-434b-9a77-1186ee5adaf8 response_code = 200 uri = /v2p
23282024-12-06T21:21:24.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61637 req_id = 6bd9faa1-acc1-4b36-910c-f982fa008dc3 response_code = 200 uri = /network-bootstore-config
23292024-12-06T21:21:24.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59572
23302024-12-06T21:21:24.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59572 req_id = 9ccaac65-4dfc-407f-806e-43709b7b0f17 response_code = 200 uri = /vpc-routes
23312024-12-06T21:21:25.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23322024-12-06T21:21:25.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59572 req_id = ff7d134c-2407-48e8-b814-21e967d508d0 response_code = 204 uri = /eip-gateways
23332024-12-06T21:21:25.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59572 req_id = 4808a095-8569-4429-88ec-576dbe73ae42 response_code = 204 uri = /vpc-routes
23342024-12-06T21:21:25.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50609
23352024-12-06T21:21:25.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50609 req_id = a177f43d-5fd9-4a7e-acda-f87441ab30d3 response_code = 200 uri = /v2p
23362024-12-06T21:21:25.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43732
23372024-12-06T21:21:25.103ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23382024-12-06T21:21:25.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23392024-12-06T21:21:25.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43732 req_id = 952fdc6a-e16b-488f-8c51-0ec287d50b4d response_code = 204 uri = /switch-ports
23402024-12-06T21:21:25.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43732 req_id = b4a46a35-7f6e-4405-b78e-5b66021a4547 response_code = 200 uri = /network-bootstore-config
23412024-12-06T21:21:36.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7664 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = f9001551-5fb6-46ef-b7b4-1db52f63650e response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
23422024-12-06T21:21:43.358ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37402
23432024-12-06T21:21:43.358ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37402 req_id = 848ca632-9ac8-4ea9-961d-aed5fe1ca1bb response_code = 200 uri = /baseboard
23442024-12-06T21:21:53.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49711
23452024-12-06T21:21:53.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49711 req_id = 3a545209-b899-49b4-80e3-3a4b8bf27af0 response_code = 200 uri = /vpc-routes
23462024-12-06T21:21:53.693ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23472024-12-06T21:21:53.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49711 req_id = 52fd684d-809a-43b7-90ad-4cc866a5a0e6 response_code = 204 uri = /eip-gateways
23482024-12-06T21:21:53.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49711 req_id = 7b0bd5ed-7894-468c-8e1c-30c682247de5 response_code = 204 uri = /vpc-routes
23492024-12-06T21:21:53.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57833
23502024-12-06T21:21:53.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57833 req_id = 18114555-89b1-4678-a7f8-5537b8312083 response_code = 200 uri = /v2p
23512024-12-06T21:21:53.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34802
23522024-12-06T21:21:53.870ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23532024-12-06T21:21:53.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23542024-12-06T21:21:53.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94249 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34802 req_id = cd9f4e1f-381f-40ab-990c-086302ca4bd2 response_code = 204 uri = /switch-ports
23552024-12-06T21:21:53.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34802 req_id = 53f5e30e-76f0-41d8-a88d-da5998d38bf3 response_code = 200 uri = /network-bootstore-config
23562024-12-06T21:21:54.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50171
23572024-12-06T21:21:54.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50171 req_id = 0da71d39-8a53-47af-b6fd-a1a4ef05e776 response_code = 200 uri = /vpc-routes
23582024-12-06T21:21:54.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41229
23592024-12-06T21:21:54.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41229 req_id = fd455b9c-e39f-4bbf-804c-65d9f26fcdb0 response_code = 200 uri = /v2p
23602024-12-06T21:21:54.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61053
23612024-12-06T21:21:54.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61053 req_id = 0ec1b91d-2d42-42fa-bbb2-6a7aa9fde785 response_code = 200 uri = /vpc-routes
23622024-12-06T21:21:54.889ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23632024-12-06T21:21:54.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50171 req_id = 72d7833e-0427-4fd4-aef8-60e3ccd58bca response_code = 204 uri = /eip-gateways
23642024-12-06T21:21:54.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50171 req_id = da861992-df4d-4bd3-ae4c-2b1af2a1dd05 response_code = 204 uri = /vpc-routes
23652024-12-06T21:21:54.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23662024-12-06T21:21:54.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61053 req_id = 2b06f6b0-182d-4518-a9f2-5dd582b370ef response_code = 204 uri = /eip-gateways
23672024-12-06T21:21:54.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61053 req_id = a65314d9-ca6c-41cc-af3b-76a56e921828 response_code = 204 uri = /vpc-routes
23682024-12-06T21:21:54.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50787
23692024-12-06T21:21:54.998ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23702024-12-06T21:21:55.035ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23712024-12-06T21:21:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50787 req_id = a9eebc3d-ee19-428f-8674-548882642901 response_code = 204 uri = /switch-ports
23722024-12-06T21:21:55.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34830
23732024-12-06T21:21:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34830 req_id = 37b0569c-e67d-4efd-86e0-57e0e2ef6b09 response_code = 200 uri = /v2p
23742024-12-06T21:21:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50787 req_id = d54ae315-7124-43e8-982c-2057b8f888c3 response_code = 200 uri = /network-bootstore-config
23752024-12-06T21:21:55.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54047
23762024-12-06T21:21:55.113ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23772024-12-06T21:21:55.149ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23782024-12-06T21:21:55.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54047 req_id = 120b1947-57e9-4930-a36d-58dbe786085d response_code = 204 uri = /switch-ports
23792024-12-06T21:21:55.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54047 req_id = dd07c08a-de09-4818-acc6-90915f0da51e response_code = 200 uri = /network-bootstore-config
23802024-12-06T21:22:06.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7807 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 4dd655c2-ef6b-44b9-b5c8-ea3d13f2232d response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
23812024-12-06T21:22:13.391ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60531
23822024-12-06T21:22:13.391ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60531 req_id = f5380b79-7516-49b2-97ae-9ebe9cff144d response_code = 200 uri = /baseboard
23832024-12-06T21:22:15.613ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23842024-12-06T21:22:15.614ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
23852024-12-06T21:22:15.646ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1851, tv_nsec: 144993096 } time_to_next_cleanup = 599.99999523s
23862024-12-06T21:22:23.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36169
23872024-12-06T21:22:23.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36169 req_id = 4bf78c24-3107-41ff-af6c-bc5c60bafa83 response_code = 200 uri = /vpc-routes
23882024-12-06T21:22:23.510ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
23892024-12-06T21:22:23.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36169 req_id = a0129107-2657-4e00-81a0-30dce2deb780 response_code = 204 uri = /eip-gateways
23902024-12-06T21:22:23.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36169 req_id = 9fb62fcf-3ac5-4846-b1a5-84bc5b458afb response_code = 204 uri = /vpc-routes
23912024-12-06T21:22:23.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59154
23922024-12-06T21:22:23.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59154 req_id = 7b13d7bb-26e8-4b66-b744-504ce975af55 response_code = 200 uri = /v2p
23932024-12-06T21:22:23.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39992
23942024-12-06T21:22:23.670ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23952024-12-06T21:22:23.709ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23962024-12-06T21:22:23.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39992 req_id = 6983e119-b832-4a98-95f5-7a89b6a9fddb response_code = 204 uri = /switch-ports
23972024-12-06T21:22:23.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39992 req_id = 62686699-6104-4026-915a-aa0d039817bc response_code = 200 uri = /network-bootstore-config
23982024-12-06T21:22:24.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44608
23992024-12-06T21:22:24.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44608 req_id = 4d73d674-fdd7-4aec-a41f-bbabe67b6fe6 response_code = 200 uri = /vpc-routes
24002024-12-06T21:22:24.670ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24012024-12-06T21:22:24.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44608 req_id = 198bc197-9bdd-4ccc-b62a-afde1e19a668 response_code = 204 uri = /eip-gateways
24022024-12-06T21:22:24.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54524
24032024-12-06T21:22:24.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54524 req_id = 050127e7-92cd-4e4e-836a-ec2794e651e0 response_code = 200 uri = /v2p
24042024-12-06T21:22:24.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44608 req_id = 298fa6e4-1e7d-4bdb-ab96-14a95ed655a5 response_code = 204 uri = /vpc-routes
24052024-12-06T21:22:24.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41780
24062024-12-06T21:22:24.749ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24072024-12-06T21:22:24.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24082024-12-06T21:22:24.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41780 req_id = e7b35ee0-a6de-4c47-a90e-998b8030f028 response_code = 204 uri = /switch-ports
24092024-12-06T21:22:24.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41780 req_id = d306dbfa-6cc8-4be9-b1b9-066656419e16 response_code = 200 uri = /network-bootstore-config
24102024-12-06T21:22:24.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65193
24112024-12-06T21:22:24.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63634
24122024-12-06T21:22:24.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63634 req_id = 713e1b47-71fc-4eaa-ad11-67adffe04ae0 response_code = 200 uri = /vpc-routes
24132024-12-06T21:22:24.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65193 req_id = aebad44e-ca3f-4b3f-8277-e6cebb3d1ca0 response_code = 200 uri = /v2p
24142024-12-06T21:22:24.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24152024-12-06T21:22:24.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63634 req_id = 1136cc0f-f009-4a1a-bd04-3a0d79419692 response_code = 204 uri = /eip-gateways
24162024-12-06T21:22:24.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63634 req_id = a1e602dd-0b34-4776-8508-ba2f0ac53875 response_code = 204 uri = /vpc-routes
24172024-12-06T21:22:24.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41173
24182024-12-06T21:22:24.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24192024-12-06T21:22:24.955ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24202024-12-06T21:22:25.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41173 req_id = e653b92b-a73a-4545-8baa-c37b2f7ec7d8 response_code = 204 uri = /switch-ports
24212024-12-06T21:22:25.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41173 req_id = 899c9ae4-dac8-4fb7-9bed-ce9e9c119e8e response_code = 200 uri = /network-bootstore-config
24222024-12-06T21:22:29.974ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24232024-12-06T21:22:36.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8362 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 08bef9e6-069f-419c-af64-b32c62c2c86c response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
24242024-12-06T21:22:43.425ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49478
24252024-12-06T21:22:43.425ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49478 req_id = 95a294c6-96fd-4a10-97cd-654412d5395f response_code = 200 uri = /baseboard
24262024-12-06T21:22:53.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60712
24272024-12-06T21:22:53.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60712 req_id = bad97368-0115-4547-99d6-728a17257d4d response_code = 200 uri = /vpc-routes
24282024-12-06T21:22:53.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34779
24292024-12-06T21:22:53.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34779 req_id = 432c62d1-873c-4340-98c8-58c2568790b2 response_code = 200 uri = /v2p
24302024-12-06T21:22:53.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24312024-12-06T21:22:53.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60712 req_id = 8320f174-0080-42d8-93db-0ea9d1c8e266 response_code = 204 uri = /eip-gateways
24322024-12-06T21:22:53.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60712 req_id = 21f9650a-cdfe-4b5e-ab0a-8857574943f6 response_code = 204 uri = /vpc-routes
24332024-12-06T21:22:53.863ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62485
24342024-12-06T21:22:53.863ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24352024-12-06T21:22:53.901ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24362024-12-06T21:22:53.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91685 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62485 req_id = cb220654-cce4-4347-bad0-863d1c5edc12 response_code = 204 uri = /switch-ports
24372024-12-06T21:22:53.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62485 req_id = 8f303ccb-a889-4615-b4c5-3e5af7e3c4a4 response_code = 200 uri = /network-bootstore-config
24382024-12-06T21:22:54.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42831
24392024-12-06T21:22:54.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42831 req_id = c0cfd9f0-9de2-4a19-b2c8-8e02610619e5 response_code = 200 uri = /vpc-routes
24402024-12-06T21:22:54.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49060
24412024-12-06T21:22:54.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49060 req_id = 582996a8-abd4-4ee3-a6c0-dbbc6dc0d715 response_code = 200 uri = /v2p
24422024-12-06T21:22:54.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24432024-12-06T21:22:54.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42831 req_id = beee6fde-b713-4f14-8e10-244bb1d8550d response_code = 204 uri = /eip-gateways
24442024-12-06T21:22:54.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42831 req_id = 64813a63-0a91-43f0-a4c2-4bf360dfac55 response_code = 204 uri = /vpc-routes
24452024-12-06T21:22:54.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64651
24462024-12-06T21:22:54.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64651 req_id = 37e20799-f381-489e-a887-4fd71e1ebd10 response_code = 200 uri = /vpc-routes
24472024-12-06T21:22:55.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24482024-12-06T21:22:55.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64651 req_id = 366516a5-4e2a-4708-af08-3107445e51ad response_code = 204 uri = /eip-gateways
24492024-12-06T21:22:55.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64651 req_id = 31bcc399-3833-429b-b143-02b111f0975c response_code = 204 uri = /vpc-routes
24502024-12-06T21:22:55.080ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38683
24512024-12-06T21:22:55.080ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24522024-12-06T21:22:55.119ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24532024-12-06T21:22:55.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38683 req_id = 520b3046-dde7-4b4d-b698-3eee95956673 response_code = 204 uri = /switch-ports
24542024-12-06T21:22:55.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47519
24552024-12-06T21:22:55.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38683 req_id = 3c9192f0-a49a-4493-a0ae-6c289acfc821 response_code = 200 uri = /network-bootstore-config
24562024-12-06T21:22:55.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24572024-12-06T21:22:55.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39556
24582024-12-06T21:22:55.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39556 req_id = 7c917d0c-1cd9-4930-8b02-518e9836c893 response_code = 200 uri = /v2p
24592024-12-06T21:22:55.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24602024-12-06T21:22:55.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47519 req_id = a0fb5372-90df-45eb-820a-71cde6f69daa response_code = 204 uri = /switch-ports
24612024-12-06T21:22:55.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47519 req_id = 86c42693-fec0-4fc9-85f7-0dc3523b7e8a response_code = 200 uri = /network-bootstore-config
24622024-12-06T21:23:06.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7256 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 7ebe9329-f6b0-4320-b19e-bd34a4b1016c response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
24632024-12-06T21:23:13.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36586
24642024-12-06T21:23:13.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36586 req_id = ce26fa9b-274e-4b33-aa81-127b27a35159 response_code = 200 uri = /baseboard
24652024-12-06T21:23:23.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45364
24662024-12-06T21:23:23.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45364 req_id = 3be67368-cfa7-4896-af0e-df46bb09eac4 response_code = 200 uri = /vpc-routes
24672024-12-06T21:23:23.581ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24682024-12-06T21:23:23.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45364 req_id = 4807b97b-f509-4bb3-99ac-43e5e3c9822c response_code = 204 uri = /eip-gateways
24692024-12-06T21:23:23.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45364 req_id = 0962d05d-1ca9-428a-813e-743a36e5c646 response_code = 204 uri = /vpc-routes
24702024-12-06T21:23:23.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51512
24712024-12-06T21:23:23.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51512 req_id = 60f5893f-533e-48eb-8178-f38d9d167173 response_code = 200 uri = /v2p
24722024-12-06T21:23:23.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53027
24732024-12-06T21:23:23.749ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24742024-12-06T21:23:23.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24752024-12-06T21:23:23.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53027 req_id = 6394c63f-d9de-4519-9290-e723de54a354 response_code = 204 uri = /switch-ports
24762024-12-06T21:23:23.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53027 req_id = ecd77bbb-02ac-430f-a2c9-fc9248870560 response_code = 200 uri = /network-bootstore-config
24772024-12-06T21:23:24.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60649
24782024-12-06T21:23:24.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60649 req_id = 7a0c8f7c-cc40-4881-9e26-285a59514053 response_code = 200 uri = /vpc-routes
24792024-12-06T21:23:24.634ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24802024-12-06T21:23:24.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60649 req_id = 996040cf-97d3-4f4a-b945-1f3e7573a87d response_code = 204 uri = /eip-gateways
24812024-12-06T21:23:24.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60649 req_id = 761ccff3-91fb-4377-8f8c-6842b7130af8 response_code = 204 uri = /vpc-routes
24822024-12-06T21:23:24.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39161
24832024-12-06T21:23:24.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39161 req_id = 4969703f-ceb3-43e5-91d8-ed796d81f815 response_code = 200 uri = /v2p
24842024-12-06T21:23:24.820ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37935
24852024-12-06T21:23:24.820ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24862024-12-06T21:23:24.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24872024-12-06T21:23:24.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124840 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37935 req_id = 1cfa213d-c4f7-47f5-9c0a-ca38b3fa48df response_code = 204 uri = /switch-ports
24882024-12-06T21:23:24.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64608
24892024-12-06T21:23:24.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64608 req_id = f7d466b5-9bdf-4585-8555-dae7b0701d9e response_code = 200 uri = /vpc-routes
24902024-12-06T21:23:24.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37935 req_id = b55a1a75-907b-4fbf-9067-0fb10b3d6efa response_code = 200 uri = /network-bootstore-config
24912024-12-06T21:23:24.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40059
24922024-12-06T21:23:24.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24932024-12-06T21:23:24.985ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24942024-12-06T21:23:25.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91516 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40059 req_id = 5b32ed26-e17c-4884-ac60-03627f9f1128 response_code = 204 uri = /switch-ports
24952024-12-06T21:23:25.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
24962024-12-06T21:23:25.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40793
24972024-12-06T21:23:25.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64608 req_id = 787dbf13-6f08-49c4-bc91-66dcb905ff33 response_code = 204 uri = /eip-gateways
24982024-12-06T21:23:25.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40059 req_id = 2a707435-1eb6-41eb-abb9-98eaf83a4b01 response_code = 200 uri = /network-bootstore-config
24992024-12-06T21:23:25.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40793 req_id = f0c924dc-0c1e-4c98-ba21-a4e006258524 response_code = 200 uri = /v2p
25002024-12-06T21:23:25.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64608 req_id = 7a24b306-d3fc-4b51-aa60-0b2cb67df48a response_code = 204 uri = /vpc-routes
25012024-12-06T21:23:36.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8193 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = f806b818-19c6-4a4c-9fbc-49c80db466d0 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
25022024-12-06T21:23:43.493ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57269
25032024-12-06T21:23:43.493ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57269 req_id = e49061b5-f7a8-4192-a277-bf3058e5e5d5 response_code = 200 uri = /baseboard
25042024-12-06T21:23:53.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54888
25052024-12-06T21:23:53.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54888 req_id = 5ea7e6bd-1734-418a-bb91-0769124bc20a response_code = 200 uri = /vpc-routes
25062024-12-06T21:23:53.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25072024-12-06T21:23:53.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54888 req_id = 40ce5158-af51-4852-9116-68d128f1e7af response_code = 204 uri = /eip-gateways
25082024-12-06T21:23:53.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54888 req_id = 8911d8b9-b233-4973-94b3-76e4ccdd47bf response_code = 204 uri = /vpc-routes
25092024-12-06T21:23:53.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58877
25102024-12-06T21:23:53.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58877 req_id = c3a97b1d-4254-4361-9d17-57f09da22f9f response_code = 200 uri = /v2p
25112024-12-06T21:23:53.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38399
25122024-12-06T21:23:53.877ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25132024-12-06T21:23:53.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25142024-12-06T21:23:53.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38399 req_id = 9b648327-3fda-4dd9-af04-66b9c84bb079 response_code = 204 uri = /switch-ports
25152024-12-06T21:23:53.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38399 req_id = a8c1fa04-59e1-45da-a8ca-149689b6bc7d response_code = 200 uri = /network-bootstore-config
25162024-12-06T21:23:54.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34307
25172024-12-06T21:23:54.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34307 req_id = fc1c347d-ef75-4648-8d2e-4d3c834d4d29 response_code = 200 uri = /vpc-routes
25182024-12-06T21:23:54.811ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25192024-12-06T21:23:54.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34307 req_id = 2f6e45a1-d3c5-43fa-ab27-af3bb7ef885b response_code = 204 uri = /eip-gateways
25202024-12-06T21:23:54.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34307 req_id = b0491362-d292-4ba1-91f3-b6fd2a7cbb98 response_code = 204 uri = /vpc-routes
25212024-12-06T21:23:54.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64441
25222024-12-06T21:23:54.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 79fed34d-344d-4c3a-aac3-744b79b5ea7b response_code = 200 uri = /vpc-routes
25232024-12-06T21:23:54.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25242024-12-06T21:23:54.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 162c3b39-ffd3-4cdd-809b-37017a206c5d response_code = 204 uri = /eip-gateways
25252024-12-06T21:23:55.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40446
25262024-12-06T21:23:55.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40446 req_id = 5c5284fc-c9f8-4cb0-b622-83e7ba507d75 response_code = 200 uri = /v2p
25272024-12-06T21:23:55.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64441 req_id = 4b008340-d9e0-41d8-ae95-13ddf12d58d2 response_code = 204 uri = /vpc-routes
25282024-12-06T21:23:55.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48267
25292024-12-06T21:23:55.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25302024-12-06T21:23:55.130ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25312024-12-06T21:23:55.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99254 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48267 req_id = 00f8c3d5-941a-4297-b559-3f096d6c81ac response_code = 204 uri = /switch-ports
25322024-12-06T21:23:55.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50989
25332024-12-06T21:23:55.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58080
25342024-12-06T21:23:55.191ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25352024-12-06T21:23:55.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48267 req_id = f2423524-711e-4de7-92ab-3e0b18e114ec response_code = 200 uri = /network-bootstore-config
25362024-12-06T21:23:55.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3750 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50989 req_id = 5b04b0e1-6e9c-4ed7-8760-881a28d9c2fc response_code = 200 uri = /v2p
25372024-12-06T21:23:55.228ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25382024-12-06T21:23:55.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58080 req_id = 20d4930b-1dd4-4623-92f9-18dea3ba128a response_code = 204 uri = /switch-ports
25392024-12-06T21:23:55.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58080 req_id = 79015deb-d5f7-4f14-8aa6-6b8d5a43217e response_code = 200 uri = /network-bootstore-config
25402024-12-06T21:24:06.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8328 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 31df3f9c-8f45-4f1d-a597-999c5dbbef9a response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
25412024-12-06T21:24:13.525ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48257
25422024-12-06T21:24:13.525ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48257 req_id = d06650b4-7fea-489d-873d-b63c3b678065 response_code = 200 uri = /baseboard
25432024-12-06T21:24:23.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35885
25442024-12-06T21:24:23.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35885 req_id = a603d799-8eb7-49cf-aff7-1604743ea327 response_code = 200 uri = /vpc-routes
25452024-12-06T21:24:23.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65102
25462024-12-06T21:24:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65102 req_id = e0c9c686-b557-4a11-8f2f-7a74b994dc9d response_code = 200 uri = /v2p
25472024-12-06T21:24:23.607ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25482024-12-06T21:24:23.607ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35885 req_id = 5b3e0081-e365-4f9c-81cc-104e34f5cc4a response_code = 204 uri = /eip-gateways
25492024-12-06T21:24:23.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35885 req_id = 347a34af-0185-43cf-9ff9-bf39c0363c4d response_code = 204 uri = /vpc-routes
25502024-12-06T21:24:23.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37660
25512024-12-06T21:24:23.621ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25522024-12-06T21:24:23.659ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25532024-12-06T21:24:23.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92123 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37660 req_id = 18686130-1aa8-4fdb-adb4-33267f36cce8 response_code = 204 uri = /switch-ports
25542024-12-06T21:24:23.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37660 req_id = f840dadc-a4e6-47f5-add8-2fb7d4d0bfc0 response_code = 200 uri = /network-bootstore-config
25552024-12-06T21:24:24.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59707
25562024-12-06T21:24:24.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59707 req_id = 0182570b-7150-4b33-9e8c-36f209651d54 response_code = 200 uri = /vpc-routes
25572024-12-06T21:24:24.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25582024-12-06T21:24:24.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59707 req_id = 87a98989-bb83-4a00-bcc1-c5099a2ef372 response_code = 204 uri = /eip-gateways
25592024-12-06T21:24:24.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59707 req_id = 69798f10-838d-44b5-8d22-75402f043fb6 response_code = 204 uri = /vpc-routes
25602024-12-06T21:24:24.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50705
25612024-12-06T21:24:24.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50705 req_id = a59d93c5-d134-43cd-b567-6b692d9faca8 response_code = 200 uri = /v2p
25622024-12-06T21:24:24.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65143
25632024-12-06T21:24:24.780ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25642024-12-06T21:24:24.819ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25652024-12-06T21:24:24.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65143 req_id = 0553e6b0-fbf8-45bc-882f-ed29d54164ff response_code = 204 uri = /switch-ports
25662024-12-06T21:24:24.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61766
25672024-12-06T21:24:24.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61766 req_id = 254e095e-55ad-4e4b-bb26-06a14e2fca9a response_code = 200 uri = /vpc-routes
25682024-12-06T21:24:24.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65143 req_id = 96ea1315-c840-4232-a358-d10024d992f2 response_code = 200 uri = /network-bootstore-config
25692024-12-06T21:24:24.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25702024-12-06T21:24:24.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61766 req_id = 69997210-8028-4a0f-9334-39d61e7191d0 response_code = 204 uri = /eip-gateways
25712024-12-06T21:24:24.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61766 req_id = 93c99945-6255-4191-8403-7f161e1ffb8e response_code = 204 uri = /vpc-routes
25722024-12-06T21:24:24.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52309
25732024-12-06T21:24:24.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52309 req_id = f15e4245-8b4d-4373-b76f-cdc842db45ab response_code = 200 uri = /v2p
25742024-12-06T21:24:24.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39641
25752024-12-06T21:24:24.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25762024-12-06T21:24:24.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25772024-12-06T21:24:25.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95464 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39641 req_id = 72f0ca69-edd4-4670-8d58-811a6194a6f6 response_code = 204 uri = /switch-ports
25782024-12-06T21:24:25.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39641 req_id = 77045abd-f901-496a-9377-f7ef9e8e3af0 response_code = 200 uri = /network-bootstore-config
25792024-12-06T21:24:36.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7908 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 37777cde-8184-4032-a701-ebd937081bf3 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
25802024-12-06T21:24:43.557ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61693
25812024-12-06T21:24:43.557ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61693 req_id = 503910a8-1666-4821-ad34-f4d17881f892 response_code = 200 uri = /baseboard
25822024-12-06T21:24:53.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41304
25832024-12-06T21:24:53.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41304 req_id = 2aeac54c-7cf1-4418-b352-6bbbecb7f427 response_code = 200 uri = /vpc-routes
25842024-12-06T21:24:53.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
25852024-12-06T21:24:53.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41304 req_id = 83fd14b9-d036-4bf4-b42d-fdb0d5799f3d response_code = 204 uri = /eip-gateways
25862024-12-06T21:24:53.654ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41304 req_id = eed689ae-615e-44a1-bccb-c64e4d89cd0a response_code = 204 uri = /vpc-routes
25872024-12-06T21:24:53.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37887
25882024-12-06T21:24:53.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37887 req_id = f507a5bc-5a9a-4f6c-8132-9bbc85eb7abd response_code = 200 uri = /v2p
25892024-12-06T21:24:53.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44813
25902024-12-06T21:24:53.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25912024-12-06T21:24:53.911ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25922024-12-06T21:24:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99034 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44813 req_id = f385c2d1-4d91-4a51-abd2-ddd4a8b5e479 response_code = 204 uri = /switch-ports
25932024-12-06T21:24:53.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48435
25942024-12-06T21:24:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44813 req_id = 51a11d65-39f5-4b06-b829-f5045bfd817a response_code = 200 uri = /network-bootstore-config
25952024-12-06T21:24:53.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25962024-12-06T21:24:53.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
25972024-12-06T21:24:53.970ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
25982024-12-06T21:24:53.971ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
25992024-12-06T21:24:53.988ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26002024-12-06T21:24:53.988ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d
26012024-12-06T21:24:54.011ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26022024-12-06T21:24:54.012ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17
26032024-12-06T21:24:54.037ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26042024-12-06T21:24:54.037ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1
26052024-12-06T21:24:54.059ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26062024-12-06T21:24:54.059ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5430cc8-489c-438a-b730-df567e7b3e13
26072024-12-06T21:24:54.081ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26082024-12-06T21:24:54.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4
26092024-12-06T21:24:54.103ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26102024-12-06T21:24:54.103ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_56416138-2c59-4897-b953-6407738ebcfc
26112024-12-06T21:24:54.124ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26122024-12-06T21:24:54.124ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1cb341c5-34e8-451b-86cd-f466ef64d711
26132024-12-06T21:24:54.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26142024-12-06T21:24:54.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae
26152024-12-06T21:24:54.169ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26162024-12-06T21:24:54.169ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c
26172024-12-06T21:24:54.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48435 req_id = d7ea0c47-4318-493a-bd48-2cd5609447f8 response_code = 200 uri = /inventory
26182024-12-06T21:24:54.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56922
26192024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26202024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26212024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26222024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26232024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26242024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26252024-12-06T21:24:54.234ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26262024-12-06T21:24:54.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 414 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56922 req_id = d585cc92-f6f2-43d6-8817-9a519c6a04c7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26272024-12-06T21:24:54.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61563
26282024-12-06T21:24:54.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61563 req_id = f769eed6-18e3-4086-9a83-fc7d6a5bb916 response_code = 200 uri = /vpc-routes
26292024-12-06T21:24:54.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
26302024-12-06T21:24:54.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61563 req_id = 738db55c-e5ab-4b8a-a6d9-f944779d1ad4 response_code = 204 uri = /eip-gateways
26312024-12-06T21:24:54.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61563 req_id = 4444edae-e932-4b61-8670-eb0b6f672ef0 response_code = 204 uri = /vpc-routes
26322024-12-06T21:24:54.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65307
26332024-12-06T21:24:54.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65307 req_id = 727d0834-cc24-4bd8-9c84-4814bc8cfe5c response_code = 200 uri = /vpc-routes
26342024-12-06T21:24:54.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
26352024-12-06T21:24:54.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65307 req_id = e61d455d-f144-4421-bc23-e3ebb4ae11b9 response_code = 204 uri = /eip-gateways
26362024-12-06T21:24:54.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65307 req_id = cc7ac077-36ab-482e-a4e7-79362c01c693 response_code = 204 uri = /vpc-routes
26372024-12-06T21:24:55.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34421
26382024-12-06T21:24:55.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34421 req_id = b39b64bb-7970-41de-8752-d7702a5c392f response_code = 200 uri = /v2p
26392024-12-06T21:24:55.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59755
26402024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26412024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26422024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26442024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26452024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26462024-12-06T21:24:55.090ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26472024-12-06T21:24:55.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59755 req_id = 2130257c-6d54-494a-9299-8c415f91e1d5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26482024-12-06T21:24:55.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46212
26492024-12-06T21:24:55.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26502024-12-06T21:24:55.121ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26512024-12-06T21:24:55.121ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
26522024-12-06T21:24:55.122ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
26532024-12-06T21:24:55.140ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26542024-12-06T21:24:55.140ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d
26552024-12-06T21:24:55.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60057
26562024-12-06T21:24:55.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26572024-12-06T21:24:55.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
26582024-12-06T21:24:55.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/config/omicron-zones.json file = common/src/ledger.rs:177
26592024-12-06T21:24:55.162ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/config/omicron-zones.json file = common/src/ledger.rs:177
26602024-12-06T21:24:55.170ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26612024-12-06T21:24:55.170ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17
26622024-12-06T21:24:55.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56791
26632024-12-06T21:24:55.176ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26642024-12-06T21:24:55.187ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f7cf49d5-6aff-42c7-b6df-04d71595cc2d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26652024-12-06T21:24:55.187ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_f7cf49d5-6aff-42c7-b6df-04d71595cc2d
26662024-12-06T21:24:55.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33563
26672024-12-06T21:24:55.212ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26682024-12-06T21:24:55.212ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1
26692024-12-06T21:24:55.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61543
26702024-12-06T21:24:55.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61543 req_id = 8011445d-0178-401a-9237-7984e5af6691 response_code = 200 uri = /v2p
26712024-12-06T21:24:55.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26722024-12-06T21:24:55.228ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bf3f9522-10af-4abe-8f5f-c62daf852c17 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26732024-12-06T21:24:55.228ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bf3f9522-10af-4abe-8f5f-c62daf852c17
26742024-12-06T21:24:55.254ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: afed364c-1eb2-4c62-a6a7-b86cf13ba8c1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26752024-12-06T21:24:55.254ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_afed364c-1eb2-4c62-a6a7-b86cf13ba8c1
26762024-12-06T21:24:55.270ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26772024-12-06T21:24:55.270ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5430cc8-489c-438a-b730-df567e7b3e13
26782024-12-06T21:24:55.287ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: c5430cc8-489c-438a-b730-df567e7b3e13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26792024-12-06T21:24:55.287ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_c5430cc8-489c-438a-b730-df567e7b3e13
26802024-12-06T21:24:55.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26812024-12-06T21:24:55.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56791 req_id = 19d00488-0dcc-44fd-a0e9-181a1ceee207 response_code = 204 uri = /switch-ports
26822024-12-06T21:24:55.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56791 req_id = 4db0ab7a-890c-4193-bc1f-adcdb7e44bc0 response_code = 200 uri = /network-bootstore-config
26832024-12-06T21:24:55.304ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26842024-12-06T21:24:55.304ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4
26852024-12-06T21:24:55.331ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26862024-12-06T21:24:55.331ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_56416138-2c59-4897-b953-6407738ebcfc
26872024-12-06T21:24:55.338ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26882024-12-06T21:24:55.345ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26892024-12-06T21:24:55.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4
26902024-12-06T21:24:55.363ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26912024-12-06T21:24:55.363ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1cb341c5-34e8-451b-86cd-f466ef64d711
26922024-12-06T21:24:55.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 56416138-2c59-4897-b953-6407738ebcfc (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26932024-12-06T21:24:55.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_56416138-2c59-4897-b953-6407738ebcfc
26942024-12-06T21:24:55.408ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1cb341c5-34e8-451b-86cd-f466ef64d711 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26952024-12-06T21:24:55.408ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1cb341c5-34e8-451b-86cd-f466ef64d711
26962024-12-06T21:24:55.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33563 req_id = f3213796-a404-49f9-81c8-0b645d1a43ab response_code = 204 uri = /switch-ports
26972024-12-06T21:24:55.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33563 req_id = 19d4d562-0f01-4a7e-ab9d-82a41a7249e5 response_code = 200 uri = /network-bootstore-config
26982024-12-06T21:24:55.423ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
26992024-12-06T21:24:55.423ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae
27002024-12-06T21:24:55.440ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3695493-89af-45c8-9f56-3d654d8ec8ae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27012024-12-06T21:24:55.440ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e3695493-89af-45c8-9f56-3d654d8ec8ae
27022024-12-06T21:24:55.457ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27032024-12-06T21:24:55.457ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c
27042024-12-06T21:24:55.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354008 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46212 req_id = 7c056491-4570-4e95-9423-00ef337626a5 response_code = 200 uri = /inventory
27052024-12-06T21:24:55.482ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f9081de-8acd-4ccb-971d-9504727f1c8c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27062024-12-06T21:24:55.482ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_0f9081de-8acd-4ccb-971d-9504727f1c8c
27072024-12-06T21:24:55.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333867 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60057 req_id = 0e82e09f-f91d-4c53-80ee-2a62bd9a2dc3 response_code = 200 uri = /inventory
27082024-12-06T21:24:55.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49135
27092024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 470a6d71-26ee-4d59-b30a-7a9e78dfa903, kind: Service { id: 709da000-e0da-4b29-8160-3112fd080927 }, name: Name("external-dns-709da000-e0da-4b29-8160-3112fd080927"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 160, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8dee8d46-edc9-4f8a-9453-2146d512c47b, kind: Service { id: a03854a6-7a78-402b-93b4-65c6d36bf236 }, name: Name("external-dns-a03854a6-7a78-402b-93b4-65c6d36bf236"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 200])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 112d04a8-d7b2-41ba-a8a9-b1b05b82789a, kind: Service { id: e8725c8c-13ab-4916-bf16-bb7f832014d5 }, name: Name("nexus-e8725c8c-13ab-4916-bf16-bb7f832014d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 172])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 3b455a5c-72a6-4c48-bc31-0f3337db4efa, kind: Service { id: a211d4f7-7350-4466-97ca-36b58597b187 }, name: Name("nexus-a211d4f7-7350-4466-97ca-36b58597b187"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 41])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 73f8344b-aadb-4eda-971a-b52bf9a56847, kind: Service { id: 0214b950-30f3-4a60-9344-b4f7d110e307 }, name: Name("nexus-0214b950-30f3-4a60-9344-b4f7d110e307"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 92])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27102024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27112024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27122024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27132024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27142024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27152024-12-06T21:24:55.506ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27162024-12-06T21:24:55.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 354 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49135 req_id = d9150bcc-5350-4282-8797-269f93bcd1fb response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27172024-12-06T21:25:06.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7837 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 828d00e2-e263-4e6a-a2a0-d619ec3057e7 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
27182024-12-06T21:25:13.590ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36617
27192024-12-06T21:25:13.590ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36617 req_id = 65f570f4-7ca4-47ef-80ef-1495082e6c53 response_code = 200 uri = /baseboard
27202024-12-06T21:25:23.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41908
27212024-12-06T21:25:23.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41908 req_id = 530a45e5-a0e9-4a4c-ae5f-dfe8e3983553 response_code = 200 uri = /vpc-routes
27222024-12-06T21:25:23.567ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
27232024-12-06T21:25:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41908 req_id = d16bada7-9ec7-4252-9c89-dec74d769335 response_code = 204 uri = /eip-gateways
27242024-12-06T21:25:23.576ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41908 req_id = 591955ff-c94d-48f7-825e-533b4e3201c7 response_code = 204 uri = /vpc-routes
27252024-12-06T21:25:23.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34732
27262024-12-06T21:25:23.619ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27272024-12-06T21:25:23.657ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27282024-12-06T21:25:23.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34732 req_id = 98e54b05-4b82-407c-8dcb-69080db317ff response_code = 204 uri = /switch-ports
27292024-12-06T21:25:23.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55096
27302024-12-06T21:25:23.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55096 req_id = e7a53026-a9b5-411b-b4c0-31ae40c4b29b response_code = 200 uri = /v2p
27312024-12-06T21:25:23.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34732 req_id = 49a5a4b9-81cc-4384-b755-49ef9dd05afb response_code = 200 uri = /network-bootstore-config
27322024-12-06T21:25:24.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32993
27332024-12-06T21:25:24.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32993 req_id = 1fa92933-1a49-4935-8676-b6cff05756f2 response_code = 200 uri = /vpc-routes
27342024-12-06T21:25:24.591ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
27352024-12-06T21:25:24.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32993 req_id = 86daf37d-82dd-455e-8936-1c9854821fc8 response_code = 204 uri = /eip-gateways
27362024-12-06T21:25:24.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32993 req_id = aabca7e1-9aa2-4ca2-8c03-6847c5333455 response_code = 204 uri = /vpc-routes
27372024-12-06T21:25:24.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60272
27382024-12-06T21:25:24.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60272 req_id = 20500e3a-327e-437d-8c40-6eb5ec33a714 response_code = 200 uri = /v2p
27392024-12-06T21:25:24.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54293
27402024-12-06T21:25:24.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27412024-12-06T21:25:24.765ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27422024-12-06T21:25:24.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100193 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54293 req_id = 1df507cc-5eb1-448e-ba86-8fd2cacad6a5 response_code = 204 uri = /switch-ports
27432024-12-06T21:25:24.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55507
27442024-12-06T21:25:24.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54293 req_id = ea85549e-eac8-48b6-86ec-ce86e66caad3 response_code = 200 uri = /network-bootstore-config
27452024-12-06T21:25:24.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55507 req_id = 1a5c9266-89c0-47a4-a455-e032ed3afcaf response_code = 200 uri = /vpc-routes
27462024-12-06T21:25:24.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
27472024-12-06T21:25:24.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55507 req_id = 6b881d42-5a36-455d-bf1e-e1feed3c1964 response_code = 204 uri = /eip-gateways
27482024-12-06T21:25:24.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56723
27492024-12-06T21:25:24.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56723 req_id = 36c6ffc5-3b4c-46c1-85c8-52c14537ec15 response_code = 200 uri = /v2p
27502024-12-06T21:25:24.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55507 req_id = 7f3bd222-f4a7-4a52-a910-921d06b2493c response_code = 204 uri = /vpc-routes
27512024-12-06T21:25:24.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39686
27522024-12-06T21:25:24.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27532024-12-06T21:25:24.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27542024-12-06T21:25:25.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98964 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39686 req_id = 9ec0b743-7a6f-4ddf-aeb5-65160798262f response_code = 204 uri = /switch-ports
27552024-12-06T21:25:25.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39686 req_id = 44dc51a0-10f9-4f33-8eb5-4ff742e80e0d response_code = 200 uri = /network-bootstore-config
27562024-12-06T21:25:36.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7566 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = 17a135c6-231d-4b28-b8fd-a1a27f85d7ac response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
27572024-12-06T21:25:43.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44881
27582024-12-06T21:25:43.622ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44881 req_id = b8ef0884-c403-4d86-8129-5434c2b639a4 response_code = 200 uri = /baseboard
27592024-12-06T21:25:44.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48414
27602024-12-06T21:25:44.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48414 req_id = 06c14973-ce0f-4abd-b5ed-235c123fa322 response_code = 200 uri = /v2p
27612024-12-06T21:25:44.747ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(1298706) }
27622024-12-06T21:25:44.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 703 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48414 req_id = 0a547a93-d2e7-449a-9e67-98ba60c70125 response_code = 204 uri = /v2p
27632024-12-06T21:25:44.842ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61935
27642024-12-06T21:25:44.853ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1298706))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-f8611b58685", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: aa188760-7f06-4ec2-b138-d654db3b3340, read_only_parent: Some(Volume { block_size: 512, id: eaa0c59a-02f1-4015-a6a0-0fe8b06c86f4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0b97db55-cf09-4530-b78e-8b2d821673a1, key: Some("rf2dkYrkcgjZRiUzR/68jtqELtjEHZ9H/lnZTIO4WdI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: aa188760-7f06-4ec2-b138-d654db3b3340, key: Some("BrcYgLENarn71SGyf9EzTBvMwFHWNdIkOIXVeNHYgDM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-f8611b58685" }] }), cloud_init_bytes: Some(..) } instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 metadata = InstanceMetadata { silo_id: 683d02e1-6ec8-48bf-98d0-db6c94785f80, project_id: 0f15cd2f-218a-418e-b184-8f82e3aecd94 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T21:25:44.842726698Z }
27652024-12-06T21:25:44.853ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 migration_id = None propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27662024-12-06T21:25:44.853ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 migration_id = None propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(1298706))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: ce30fdf2-f481-4444-a53b-35bded50bb2c, kind: Instance { id: 205c5de4-679a-4f08-8613-9b6f8d3a48e3 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(1298706), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-f8611b58685", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: aa188760-7f06-4ec2-b138-d654db3b3340, read_only_parent: Some(Volume { block_size: 512, id: eaa0c59a-02f1-4015-a6a0-0fe8b06c86f4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 0b97db55-cf09-4530-b78e-8b2d821673a1, key: Some("rf2dkYrkcgjZRiUzR/68jtqELtjEHZ9H/lnZTIO4WdI="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19002", "[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: aa188760-7f06-4ec2-b138-d654db3b3340, key: Some("BrcYgLENarn71SGyf9EzTBvMwFHWNdIkOIXVeNHYgDM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::15]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-f8611b58685" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-12-06T21:25:44.842726698Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27672024-12-06T21:25:44.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11966 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61935 req_id = e068da7a-d14b-4f9b-afcf-c2e510c8ec81 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27682024-12-06T21:25:44.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52048
27692024-12-06T21:25:44.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52048 req_id = c08d62df-a103-40d5-9dfe-1c66050fc4a6 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7/state
27702024-12-06T21:25:44.963ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 1298706 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27712024-12-06T21:25:44.963ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27722024-12-06T21:25:44.997ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7 file = illumos-utils/src/zone.rs:325 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27732024-12-06T21:25:45.021ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7 file = illumos-utils/src/zone.rs:363 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27742024-12-06T21:25:45.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40804
27752024-12-06T21:25:45.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40804 req_id = 9517431d-5cd2-4f8f-8eae-46b8755ff531 response_code = 200 uri = /vpc-routes
27762024-12-06T21:25:45.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {ce30fdf2-f481-4444-a53b-35bded50bb2c: {10.151.2.176: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}, 10.151.2.175: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}}} }
27772024-12-06T21:25:46.595ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27782024-12-06T21:25:46.595ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27792024-12-06T21:25:46.761ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 37.638671ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27802024-12-06T21:25:46.809ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 146.88071ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27812024-12-06T21:25:46.972ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 179.828796ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27822024-12-06T21:25:47.170ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 564.406527ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27832024-12-06T21:25:47.745ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 744.44336ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27842024-12-06T21:25:48.501ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 1.366108275s file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27852024-12-06T21:25:49.879ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 777.862391ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27862024-12-06T21:25:50.667ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 1.357141162s file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 zone = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27872024-12-06T21:25:52.052ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7 file = sled-agent/src/instance.rs:1786 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27882024-12-06T21:25:52.061ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 26.195452ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27892024-12-06T21:25:52.096ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7") failed: Property not found. retry in 105.497594ms file = illumos-utils/src/svc.rs:36 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27902024-12-06T21:25:52.213ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27912024-12-06T21:25:52.249ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27922024-12-06T21:25:52.389ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27932024-12-06T21:25:52.390ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-12-06T21:25:52.390590776Z } file = sled-agent/src/instance.rs:780 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27942024-12-06T21:25:52.390ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T21:25:52.390590776Z } propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27952024-12-06T21:25:52.390ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-06T21:25:52.390590776Z }, migration_in: None, migration_out: None }
27962024-12-06T21:25:52.390ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
27972024-12-06T21:25:52.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7332316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40804 req_id = 7b7f288c-5f37-4852-9d8d-5bc05879e3f0 response_code = 204 uri = /eip-gateways
27982024-12-06T21:25:52.449ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-12-06T21:25:52.449420701Z } file = sled-agent/src/instance.rs:780 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
27992024-12-06T21:25:52.449ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T21:25:52.449420701Z } propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28002024-12-06T21:25:52.449ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-06T21:25:52.449420701Z }, migration_in: None, migration_out: None }
28012024-12-06T21:25:52.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40804 req_id = 2d902da3-ea02-4e1d-b1a7-b7bce9c062ff response_code = 204 uri = /vpc-routes
28022024-12-06T21:25:53.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65411
28032024-12-06T21:25:53.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65411 req_id = 772780fe-65ca-4f8d-8af4-5396eaa54b19 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7/state
28042024-12-06T21:25:53.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50912
28052024-12-06T21:25:53.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50912 req_id = 558e5704-c30a-4fb2-910f-be28b5bd24e4 response_code = 200 uri = /vpc-routes
28062024-12-06T21:25:53.885ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {ce30fdf2-f481-4444-a53b-35bded50bb2c: {10.151.2.175: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}, 10.151.2.176: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}}} }
28072024-12-06T21:25:53.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50912 req_id = c383029c-d8bc-4fee-8834-4c3028c37d6d response_code = 204 uri = /eip-gateways
28082024-12-06T21:25:53.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50912 req_id = 0a1ec6cc-614e-4a9e-893d-ecf466b55299 response_code = 204 uri = /vpc-routes
28092024-12-06T21:25:53.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44006
28102024-12-06T21:25:53.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44006 req_id = 2823f7b7-1453-4e72-8c27-d2b9fce91db3 response_code = 200 uri = /v2p
28112024-12-06T21:25:53.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62814
28122024-12-06T21:25:53.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28132024-12-06T21:25:54.017ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28142024-12-06T21:25:54.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91624 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62814 req_id = 06208a76-5427-4e99-9688-1a4948367772 response_code = 204 uri = /switch-ports
28152024-12-06T21:25:54.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62814 req_id = afbc1ac6-bb62-496a-b059-47e2bfc94bec response_code = 200 uri = /network-bootstore-config
28162024-12-06T21:25:54.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49319
28172024-12-06T21:25:54.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49319 req_id = e34afa6e-7b5c-4de2-9cb2-6856cf2d2925 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7/state
28182024-12-06T21:25:54.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64861
28192024-12-06T21:25:54.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64861 req_id = 8f5d07e2-6eff-44ae-938c-a463cbead5c2 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7/state
28202024-12-06T21:25:54.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65198
28212024-12-06T21:25:54.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65198 req_id = bc051ea7-19e5-41e0-93ea-15175f219ad7 response_code = 200 uri = /vpc-routes
28222024-12-06T21:25:55.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60033
28232024-12-06T21:25:55.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60033 req_id = 6496b750-8a50-4b06-9d85-1cda6d18a761 response_code = 200 uri = /vpc-routes
28242024-12-06T21:25:55.035ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60687
28252024-12-06T21:25:55.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60687 req_id = 60531f8c-27ee-4e00-bc74-97b32b800ad6 response_code = 200 uri = /v2p
28262024-12-06T21:25:55.049ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {ce30fdf2-f481-4444-a53b-35bded50bb2c: {10.151.2.175: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}, 10.151.2.176: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}}} }
28272024-12-06T21:25:55.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65198 req_id = 4a1a0324-863d-4590-a907-42a7bacd1215 response_code = 204 uri = /eip-gateways
28282024-12-06T21:25:55.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55551
28292024-12-06T21:25:55.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28302024-12-06T21:25:55.097ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28312024-12-06T21:25:55.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104453 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55551 req_id = ccd7355a-c0a7-413c-b24c-a0ac86aac53e response_code = 204 uri = /switch-ports
28322024-12-06T21:25:55.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33707
28332024-12-06T21:25:55.158ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {ce30fdf2-f481-4444-a53b-35bded50bb2c: {10.151.2.175: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}, 10.151.2.176: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}}} }
28342024-12-06T21:25:55.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60033 req_id = 501b8f99-2e45-45a8-8e1a-258a752b13b5 response_code = 204 uri = /eip-gateways
28352024-12-06T21:25:55.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55551 req_id = 24fb12cf-73d5-4bd2-8c7a-d9af4fe81041 response_code = 200 uri = /network-bootstore-config
28362024-12-06T21:25:55.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33707 req_id = 3b7d2156-2518-4592-9def-898e3cc3d7b5 response_code = 200 uri = /v2p
28372024-12-06T21:25:55.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65198 req_id = e6df2085-b078-498d-8556-9a270db88ed2 response_code = 204 uri = /vpc-routes
28382024-12-06T21:25:55.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60033 req_id = d869c13d-c49e-41eb-b23c-c63667874886 response_code = 204 uri = /vpc-routes
28392024-12-06T21:25:55.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43744
28402024-12-06T21:25:55.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28412024-12-06T21:25:55.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28422024-12-06T21:25:55.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100047 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43744 req_id = 65c8fe62-ee51-47a4-ad9a-759613d9c5a0 response_code = 204 uri = /switch-ports
28432024-12-06T21:25:55.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43744 req_id = 9bd62361-a09d-43ee-91a9-c44525040805 response_code = 200 uri = /network-bootstore-config
28442024-12-06T21:26:03.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35236
28452024-12-06T21:26:03.334ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35236 req_id = 39b27f98-5468-44be-b383-b6bc8629ce31 response_code = 200 uri = /vmms/bac2d732-e506-44e4-ae8b-e6d67d6a7be7/state
28462024-12-06T21:26:03.334ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-12-06T21:26:03.334177732Z } file = sled-agent/src/instance.rs:780 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28472024-12-06T21:26:03.334ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T21:26:03.334177732Z } propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28482024-12-06T21:26:03.334ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-06T21:26:03.334177732Z }, migration_in: None, migration_out: None }
28492024-12-06T21:26:03.347ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-12-06T21:26:03.347190555Z } file = sled-agent/src/instance.rs:780 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28502024-12-06T21:26:03.347ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-12-06T21:26:03.347190555Z } propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28512024-12-06T21:26:03.347ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28522024-12-06T21:26:03.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28532024-12-06T21:26:03.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28542024-12-06T21:26:03.347ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/4dcbd7ec-2d12-40b3-92d5-d9548d93b746/debug/bundle/zone", "/pool/int/cee4e847-3bb9-425f-a5d6-c199bac4aab1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/f7cf49d5-6aff-42c7-b6df-04d71595cc2d/crypt/debug", "/pool/ext/bf3f9522-10af-4abe-8f5f-c62daf852c17/crypt/debug", "/pool/ext/afed364c-1eb2-4c62-a6a7-b86cf13ba8c1/crypt/debug", "/pool/ext/c5430cc8-489c-438a-b730-df567e7b3e13/crypt/debug", "/pool/ext/a4e1bc6f-c2e1-42a8-86bd-0f25d05d58f4/crypt/debug", "/pool/ext/56416138-2c59-4897-b953-6407738ebcfc/crypt/debug", "/pool/ext/1cb341c5-34e8-451b-86cd-f466ef64d711/crypt/debug", "/pool/ext/e3695493-89af-45c8-9f56-3d654d8ec8ae/crypt/debug", "/pool/ext/0f9081de-8acd-4ccb-971d-9504727f1c8c/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28552024-12-06T21:26:03.348ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14737247002924383093 n_samples = 6 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
28562024-12-06T21:26:03.348ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 13544878126392991468 n_samples = 6 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
28572024-12-06T21:26:03.992ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7", bundle_id: b029754c-6a17-4079-8438-9774a5a215c2 }, time_created: 2024-12-06T21:26:03.348042989Z, version: 0, cause: TerminatedInstance }
28582024-12-06T21:26:03.992ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_bac2d732-e506-44e4-ae8b-e6d67d6a7be7 file = sled-agent/src/instance.rs:1032 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28592024-12-06T21:26:05.765ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28602024-12-06T21:26:05.784ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1298706), kind: System }
28612024-12-06T21:26:05.784ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(1298706), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28622024-12-06T21:26:05.785ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T21:26:05.785401166Z }, migration_in: None, migration_out: None }
28632024-12-06T21:26:05.809ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-06T21:26:05.785401166Z }, migration_in: None, migration_out: None }
28642024-12-06T21:26:05.814ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 205c5de4-679a-4f08-8613-9b6f8d3a48e3 propolis_id = bac2d732-e506-44e4-ae8b-e6d67d6a7be7
28652024-12-06T21:26:06.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47692
28662024-12-06T21:26:06.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47692 req_id = cb797957-eb64-49ac-8750-9a64ce46856f response_code = 200 uri = /vpc-routes
28672024-12-06T21:26:06.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {ce30fdf2-f481-4444-a53b-35bded50bb2c: {10.151.2.175: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}, 10.151.2.176: {8a0a43ee-1fc8-4092-9c8c-ea2df63f15f7}}} }
28682024-12-06T21:26:06.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47692 req_id = 701a9836-df67-437a-b89b-03010f8f48e1 response_code = 204 uri = /eip-gateways
28692024-12-06T21:26:06.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47692 req_id = ab7c5c5c-f5a2-40a7-a95a-3c19835c3b8f response_code = 204 uri = /vpc-routes
28702024-12-06T21:26:06.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52736
28712024-12-06T21:26:06.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52736 req_id = 58402153-e9ca-4c40-990a-7fd469c20973 response_code = 200 uri = /v2p
28722024-12-06T21:26:06.557ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8709 local_addr = [fd00:1122:3344:101::1]:48012 method = GET remote_addr = [fd00:1122:3344:101::d]:59834 req_id = a4cfbf66-a05e-4238-8419-b71387c36ad7 response_code = 200 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 uri = /cbc5c1c6-5668-455a-85ef-94f4aebe0f80
28732024-12-06T21:26:06.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43198
28742024-12-06T21:26:06.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43198 req_id = e9844404-5a4c-4971-aa26-6de3ceaadfeb response_code = 200 uri = /v2p
28752024-12-06T21:26:06.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36753
28762024-12-06T21:26:06.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36753 req_id = 6eb6e1ad-b2b4-46a7-8543-de4f7ddced96 response_code = 200 uri = /vpc-routes
28772024-12-06T21:26:06.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
28782024-12-06T21:26:06.822ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80
28792024-12-06T21:26:06.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36753 req_id = 7aa7b553-77f5-4de6-9f61-c1a3fefbe88e response_code = 204 uri = /eip-gateways
28802024-12-06T21:26:06.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36753 req_id = 62e8780d-18b2-47e8-925b-6e85d76e3e21 response_code = 204 uri = /vpc-routes
28812024-12-06T21:26:07.477ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33106
28822024-12-06T21:26:07.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33106 req_id = 77dbbae6-3579-48f8-8bd9-63b6cf6e946a response_code = 200 uri = /vpc-routes
28832024-12-06T21:26:07.491ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = cbc5c1c6-5668-455a-85ef-94f4aebe0f80 values = ExternalIpGatewayMap { mappings: {} }
28842024-12-06T21:26:07.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33106 req_id = 39044437-33ed-46a9-8ad6-5ea36831c3d6 response_code = 204 uri = /eip-gateways
28852024-12-06T21:26:07.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33106 req_id = 2a62070d-b389-4b2e-9fe4-24ead0ca5550 response_code = 204 uri = /vpc-routes